Max level shown:
12025-01-25T00:15:00.977ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 525 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 10cd05af-1e46-42d0-9dd2-692c181bb07c response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
22025-01-25T00:15:01.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f9e4bfea-af9f-4829-a397-a154ffa974e0 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
32025-01-25T00:15:01.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f9e4bfea-af9f-4829-a397-a154ffa974e0 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
42025-01-25T00:15:01.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f9e4bfea-af9f-4829-a397-a154ffa974e0 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
52025-01-25T00:15:02.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a7f0331b-2369-471f-9146-502616e9610c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
62025-01-25T00:15:02.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a7f0331b-2369-471f-9146-502616e9610c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72025-01-25T00:15:02.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a7f0331b-2369-471f-9146-502616e9610c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82025-01-25T00:15:03.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c8f24922-1992-40ba-902a-4539d8ed880a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
92025-01-25T00:15:03.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c8f24922-1992-40ba-902a-4539d8ed880a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
102025-01-25T00:15:03.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c8f24922-1992-40ba-902a-4539d8ed880a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
112025-01-25T00:15:04.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e6368931-47eb-43f4-b386-599b9c5a6e55 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
122025-01-25T00:15:04.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e6368931-47eb-43f4-b386-599b9c5a6e55 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
132025-01-25T00:15:04.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e6368931-47eb-43f4-b386-599b9c5a6e55 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
142025-01-25T00:15:05.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e394bad6-ed19-4e5d-890d-16262306d08d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
152025-01-25T00:15:05.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e394bad6-ed19-4e5d-890d-16262306d08d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
162025-01-25T00:15:05.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e394bad6-ed19-4e5d-890d-16262306d08d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
172025-01-25T00:15:06.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7779a4fd-f0b1-4bf4-98f8-5d0a1df7855c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
182025-01-25T00:15:06.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7779a4fd-f0b1-4bf4-98f8-5d0a1df7855c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
192025-01-25T00:15:06.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7779a4fd-f0b1-4bf4-98f8-5d0a1df7855c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
202025-01-25T00:15:07.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b103ee6-9692-43f8-9aff-1a4ffd733a70 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
212025-01-25T00:15:07.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b103ee6-9692-43f8-9aff-1a4ffd733a70 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
222025-01-25T00:15:07.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b103ee6-9692-43f8-9aff-1a4ffd733a70 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
232025-01-25T00:15:08.413ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
242025-01-25T00:15:08.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
252025-01-25T00:15:08.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
262025-01-25T00:15:08.413ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
272025-01-25T00:15:08.413ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
282025-01-25T00:15:08.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
292025-01-25T00:15:08.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
302025-01-25T00:15:08.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
312025-01-25T00:15:08.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
322025-01-25T00:15:08.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
332025-01-25T00:15:08.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
342025-01-25T00:15:08.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
352025-01-25T00:15:08.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
362025-01-25T00:15:08.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
372025-01-25T00:15:08.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
382025-01-25T00:15:08.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
392025-01-25T00:15:08.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
402025-01-25T00:15:08.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
412025-01-25T00:15:08.435ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
422025-01-25T00:15:08.435ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.652298ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
432025-01-25T00:15:08.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.67976ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
442025-01-25T00:15:08.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0de8eb33-95be-474e-b1c7-a2c5ef873f3d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
452025-01-25T00:15:08.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0de8eb33-95be-474e-b1c7-a2c5ef873f3d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
462025-01-25T00:15:08.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0de8eb33-95be-474e-b1c7-a2c5ef873f3d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
472025-01-25T00:15:09.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4d9860ae-341d-4514-ac54-8b6c2a7dda15 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
482025-01-25T00:15:09.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4d9860ae-341d-4514-ac54-8b6c2a7dda15 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
492025-01-25T00:15:09.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4d9860ae-341d-4514-ac54-8b6c2a7dda15 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
502025-01-25T00:15:10.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 606 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 06e75036-0ac0-483e-9b0e-52ad03788432 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
512025-01-25T00:15:11.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d151336a-5578-41de-8c9d-9bd6a5ae45be roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
522025-01-25T00:15:11.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d151336a-5578-41de-8c9d-9bd6a5ae45be resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
532025-01-25T00:15:11.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d151336a-5578-41de-8c9d-9bd6a5ae45be response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
542025-01-25T00:15:12.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e8b1d6a5-c27d-4f7e-a444-93ccdabb2b47 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
552025-01-25T00:15:12.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e8b1d6a5-c27d-4f7e-a444-93ccdabb2b47 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
562025-01-25T00:15:12.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e8b1d6a5-c27d-4f7e-a444-93ccdabb2b47 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
572025-01-25T00:15:13.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 159cd84c-981e-480d-996d-46493d100ac6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
582025-01-25T00:15:13.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 159cd84c-981e-480d-996d-46493d100ac6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
592025-01-25T00:15:13.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 159cd84c-981e-480d-996d-46493d100ac6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
602025-01-25T00:15:14.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 03004762-d3bc-47ce-baa5-626fe98950d6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
612025-01-25T00:15:14.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 03004762-d3bc-47ce-baa5-626fe98950d6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
622025-01-25T00:15:14.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 03004762-d3bc-47ce-baa5-626fe98950d6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
632025-01-25T00:15:15.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a828658f-3b9a-406d-8d75-a3c2a376dc47 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
642025-01-25T00:15:15.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a828658f-3b9a-406d-8d75-a3c2a376dc47 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
652025-01-25T00:15:15.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a828658f-3b9a-406d-8d75-a3c2a376dc47 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
662025-01-25T00:15:16.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a2153ac4-5ba8-4312-886d-b3ad320ecf3a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
672025-01-25T00:15:16.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a2153ac4-5ba8-4312-886d-b3ad320ecf3a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
682025-01-25T00:15:16.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a2153ac4-5ba8-4312-886d-b3ad320ecf3a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
692025-01-25T00:15:17.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0e136099-2912-41c3-a84f-dc8bdd1cc7da roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
702025-01-25T00:15:17.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0e136099-2912-41c3-a84f-dc8bdd1cc7da resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
712025-01-25T00:15:17.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0e136099-2912-41c3-a84f-dc8bdd1cc7da response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
722025-01-25T00:15:18.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2ab25f0b-ecf9-4d52-b7c1-0dd9ef535952 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
732025-01-25T00:15:18.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2ab25f0b-ecf9-4d52-b7c1-0dd9ef535952 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
742025-01-25T00:15:18.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2ab25f0b-ecf9-4d52-b7c1-0dd9ef535952 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
752025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
762025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
772025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
782025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
792025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
802025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
812025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
822025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
832025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
842025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
852025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
862025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
872025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
882025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
892025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
902025-01-25T00:15:18.413ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2
912025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.89\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2"}
922025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
932025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
942025-01-25T00:15:18.413ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
952025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
962025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
972025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
982025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
992025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1002025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1012025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
1022025-01-25T00:15:18.413ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-25 00:05:18.413524159 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1032025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1042025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
1052025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
1062025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
1072025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1082025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1092025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
1102025-01-25T00:15:18.413ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1112025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1122025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
1132025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
1142025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1152025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
1162025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
1172025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
1182025-01-25T00:15:18.414ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1192025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1202025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
1212025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
1222025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1232025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1242025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
1252025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1262025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1272025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
1282025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
1292025-01-25T00:15:18.414ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
1302025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
1312025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1322025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
1332025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1342025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
1352025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1362025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
1372025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1382025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1392025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
1402025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1412025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
1422025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
1432025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1442025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1452025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1462025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1472025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1482025-01-25T00:15:18.414ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("167a4f68-f407-48e5-a9a6-22f96a22bf2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3a6aa3c-ea79-4881-9aa5-b12ba496f837.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 140797838 } })
1492025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1502025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1512025-01-25T00:15:18.414ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22685765-7656-499f-8835-1c19f38e16e6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 140961739 } })
1522025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1532025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1542025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1552025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1562025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1572025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1582025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1592025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1602025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
1612025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1622025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1632025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1642025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1652025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
1662025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1672025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1682025-01-25T00:15:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1692025-01-25T00:15:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1702025-01-25T00:15:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1712025-01-25T00:15:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1722025-01-25T00:15:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1732025-01-25T00:15:18.415ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1742025-01-25T00:15:18.415ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.299177ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1752025-01-25T00:15:18.415ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1762025-01-25T00:15:18.415ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.557719ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1772025-01-25T00:15:18.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1782025-01-25T00:15:18.416ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792025-01-25T00:15:18.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1802025-01-25T00:15:18.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1812025-01-25T00:15:18.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1822025-01-25T00:15:18.416ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1832025-01-25T00:15:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1842025-01-25T00:15:18.417ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.028121ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1852025-01-25T00:15:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1862025-01-25T00:15:18.419ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1872025-01-25T00:15:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1882025-01-25T00:15:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1892025-01-25T00:15:18.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1902025-01-25T00:15:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1912025-01-25T00:15:18.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1922025-01-25T00:15:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1932025-01-25T00:15:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1942025-01-25T00:15:18.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1952025-01-25T00:15:18.422ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 149355883 } })
1962025-01-25T00:15:18.423ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
1972025-01-25T00:15:18.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.432929ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
1982025-01-25T00:15:18.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1992025-01-25T00:15:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2002025-01-25T00:15:18.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2012025-01-25T00:15:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2022025-01-25T00:15:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2032025-01-25T00:15:18.425ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2042025-01-25T00:15:18.425ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2052025-01-25T00:15:18.426ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2062025-01-25T00:15:18.427ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 153841696 } })
2072025-01-25T00:15:18.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2082025-01-25T00:15:18.427ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
2092025-01-25T00:15:18.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2102025-01-25T00:15:18.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2112025-01-25T00:15:18.427ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2122025-01-25T00:15:18.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2132025-01-25T00:15:18.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2142025-01-25T00:15:18.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2152025-01-25T00:15:18.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2162025-01-25T00:15:18.429ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2172025-01-25T00:15:18.429ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2182025-01-25T00:15:18.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2192025-01-25T00:15:18.429ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-25 00:05:18.413524159 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2202025-01-25T00:15:18.429ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.381036ms iteration = 6 status = {"expiration":"2025-01-25T00:05:18.413524159Z","pruned":[]}
2212025-01-25T00:15:18.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2222025-01-25T00:15:18.439ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.043545ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
2232025-01-25T00:15:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2242025-01-25T00:15:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2252025-01-25T00:15:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2262025-01-25T00:15:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2272025-01-25T00:15:18.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2282025-01-25T00:15:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2292025-01-25T00:15:18.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
2302025-01-25T00:15:18.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
2312025-01-25T00:15:18.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
2322025-01-25T00:15:18.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2332025-01-25T00:15:18.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2342025-01-25T00:15:18.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.842636ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2352025-01-25T00:15:18.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 174979856 } })
2362025-01-25T00:15:18.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
2372025-01-25T00:15:18.452ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2382025-01-25T00:15:18.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2392025-01-25T00:15:18.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2402025-01-25T00:15:18.453ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2412025-01-25T00:15:18.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2422025-01-25T00:15:18.456ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2432025-01-25T00:15:18.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2442025-01-25T00:15:18.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2452025-01-25T00:15:18.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
2462025-01-25T00:15:18.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
2472025-01-25T00:15:18.473ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2482025-01-25T00:15:18.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2492025-01-25T00:15:18.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2502025-01-25T00:15:18.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2512025-01-25T00:15:18.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 85.204893ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
2522025-01-25T00:15:18.499ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2532025-01-25T00:15:18.499ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2542025-01-25T00:15:18.500ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2552025-01-25T00:15:18.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2562025-01-25T00:15:18.502ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2572025-01-25T00:15:18.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2582025-01-25T00:15:18.503ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2592025-01-25T00:15:18.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2602025-01-25T00:15:18.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2612025-01-25T00:15:18.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2622025-01-25T00:15:18.508ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2632025-01-25T00:15:18.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2642025-01-25T00:15:18.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2652025-01-25T00:15:18.513ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2662025-01-25T00:15:18.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2672025-01-25T00:15:18.514ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2682025-01-25T00:15:18.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2692025-01-25T00:15:18.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2702025-01-25T00:15:18.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2712025-01-25T00:15:18.518ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2722025-01-25T00:15:18.518ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2732025-01-25T00:15:18.518ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2742025-01-25T00:15:18.518ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 105.488199ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2752025-01-25T00:15:18.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2762025-01-25T00:15:18.519ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2772025-01-25T00:15:18.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2782025-01-25T00:15:18.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2792025-01-25T00:15:18.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2802025-01-25T00:15:18.522ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2812025-01-25T00:15:18.522ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2822025-01-25T00:15:18.522ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2832025-01-25T00:15:18.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2842025-01-25T00:15:18.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2852025-01-25T00:15:18.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
2862025-01-25T00:15:18.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2872025-01-25T00:15:18.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2882025-01-25T00:15:18.527ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2892025-01-25T00:15:18.527ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2902025-01-25T00:15:18.527ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.910743ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2912025-01-25T00:15:18.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2922025-01-25T00:15:18.530ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2932025-01-25T00:15:18.530ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2942025-01-25T00:15:18.530ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2952025-01-25T00:15:18.530ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 116.402187ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2962025-01-25T00:15:18.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2972025-01-25T00:15:18.551ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
2982025-01-25T00:15:18.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
2992025-01-25T00:15:18.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
3002025-01-25T00:15:18.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3012025-01-25T00:15:18.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3022025-01-25T00:15:18.562ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3032025-01-25T00:15:18.562ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3042025-01-25T00:15:18.562ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3052025-01-25T00:15:18.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3062025-01-25T00:15:18.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3072025-01-25T00:15:18.566ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3082025-01-25T00:15:18.601ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
3092025-01-25T00:15:18.601ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3102025-01-25T00:15:18.601ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
3112025-01-25T00:15:18.601ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3122025-01-25T00:15:18.601ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "281986c7-d729-4383-a9f3-9a8ee7e54b3b", "content-length": "26", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
3132025-01-25T00:15:18.601ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3142025-01-25T00:15:18.602ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02e289c1-27f6-43f7-b950-2526482062ff", "content-length": "26", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
3152025-01-25T00:15:18.602ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3162025-01-25T00:15:18.602ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
3172025-01-25T00:15:18.602ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3182025-01-25T00:15:18.603ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76778e16-60e6-4efa-9914-f2b93674b117", "content-length": "26", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
3192025-01-25T00:15:18.603ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3202025-01-25T00:15:18.606ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3212025-01-25T00:15:18.609ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
3222025-01-25T00:15:18.610ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3232025-01-25T00:15:18.619ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3242025-01-25T00:15:18.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3252025-01-25T00:15:18.685ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3262025-01-25T00:15:18.685ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3272025-01-25T00:15:18.685ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3acd1a44-42af-4c36-8cab-a8d237b27ac1", "content-length": "372", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
3282025-01-25T00:15:18.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3292025-01-25T00:15:18.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3302025-01-25T00:15:18.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 274.108688ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3312025-01-25T00:15:18.688ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3322025-01-25T00:15:18.688ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3332025-01-25T00:15:18.688ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3342025-01-25T00:15:18.688ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3352025-01-25T00:15:18.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3362025-01-25T00:15:18.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3372025-01-25T00:15:18.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3382025-01-25T00:15:18.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3392025-01-25T00:15:18.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3402025-01-25T00:15:18.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3412025-01-25T00:15:18.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3422025-01-25T00:15:18.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3432025-01-25T00:15:18.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3442025-01-25T00:15:18.696ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3452025-01-25T00:15:18.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
3462025-01-25T00:15:18.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
3472025-01-25T00:15:18.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
3482025-01-25T00:15:18.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3492025-01-25T00:15:18.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3502025-01-25T00:15:18.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3512025-01-25T00:15:18.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3522025-01-25T00:15:18.703ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3532025-01-25T00:15:18.703ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3542025-01-25T00:15:18.703ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 289.335897ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3552025-01-25T00:15:18.704ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
3562025-01-25T00:15:18.704ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 290.903305ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
3572025-01-25T00:15:18.705ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
3582025-01-25T00:15:18.705ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
3592025-01-25T00:15:18.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
3602025-01-25T00:15:18.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 293.993871ms iteration = 4 status = {}
3612025-01-25T00:15:18.718ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3622025-01-25T00:15:18.722ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3632025-01-25T00:15:18.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3642025-01-25T00:15:18.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 317.810775ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3652025-01-25T00:15:18.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3662025-01-25T00:15:18.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3672025-01-25T00:15:18.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3682025-01-25T00:15:18.735ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3692025-01-25T00:15:18.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3702025-01-25T00:15:18.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3712025-01-25T00:15:18.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3722025-01-25T00:15:18.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3732025-01-25T00:15:18.738ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3742025-01-25T00:15:18.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
3752025-01-25T00:15:18.741ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
3762025-01-25T00:15:18.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
3772025-01-25T00:15:18.746ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3782025-01-25T00:15:18.748ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3792025-01-25T00:15:18.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3802025-01-25T00:15:18.748ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3812025-01-25T00:15:18.748ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3822025-01-25T00:15:18.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3832025-01-25T00:15:18.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3842025-01-25T00:15:18.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
3852025-01-25T00:15:18.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3862025-01-25T00:15:18.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3872025-01-25T00:15:18.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3882025-01-25T00:15:18.751ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3892025-01-25T00:15:18.751ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 0 version = 2
3902025-01-25T00:15:18.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3912025-01-25T00:15:18.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3922025-01-25T00:15:18.751ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 338.437313ms iteration = 11 status = 0
3932025-01-25T00:15:18.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3942025-01-25T00:15:18.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3952025-01-25T00:15:18.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3962025-01-25T00:15:18.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3972025-01-25T00:15:18.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3982025-01-25T00:15:18.760ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3992025-01-25T00:15:18.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4002025-01-25T00:15:18.760ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
4012025-01-25T00:15:18.760ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4022025-01-25T00:15:18.760ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-25 00:10:46.879674 UTC dns_group = internal generation = 1
4032025-01-25T00:15:18.760ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 347.65339ms iteration = 6 status = {"generation":1}
4042025-01-25T00:15:18.761ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4052025-01-25T00:15:18.761ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "74a4d4a3-d684-472b-b5ac-28df2346d461", "content-length": "1", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
4062025-01-25T00:15:18.762ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 1 version = 2
4072025-01-25T00:15:18.762ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
4082025-01-25T00:15:18.762ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-25 00:10:47.835608 UTC dns_group = external generation = 2
4092025-01-25T00:15:18.762ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 349.075747ms iteration = 6 status = {"generation":2}
4102025-01-25T00:15:18.763ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4112025-01-25T00:15:18.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4122025-01-25T00:15:18.764ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
4132025-01-25T00:15:18.764ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4142025-01-25T00:15:18.764ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "39b03b95-c00c-43fe-a3a3-c3fd0ad80e56", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
4152025-01-25T00:15:18.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4162025-01-25T00:15:18.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4172025-01-25T00:15:18.766ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 352.544476ms iteration = 11 status = null
4182025-01-25T00:15:18.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 353.33477ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
4192025-01-25T00:15:18.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4202025-01-25T00:15:18.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4212025-01-25T00:15:18.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4222025-01-25T00:15:18.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4232025-01-25T00:15:18.773ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4242025-01-25T00:15:18.773ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4252025-01-25T00:15:18.774ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "72675820-f54b-4bf0-8b78-39c56d964b79", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
4262025-01-25T00:15:18.775ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 362.204076ms iteration = 11 status = {}
4272025-01-25T00:15:18.776ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4282025-01-25T00:15:18.776ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 362.264787ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4292025-01-25T00:15:18.783ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4302025-01-25T00:15:18.786ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-25T00:10:16.530962Z, time_modified: 2025-01-25T00:10:16.530962Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }) }
4312025-01-25T00:15:18.786ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 372.465309ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]}},"default_endpoint":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4322025-01-25T00:15:18.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4332025-01-25T00:15:18.787ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4342025-01-25T00:15:18.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4352025-01-25T00:15:18.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4362025-01-25T00:15:18.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4372025-01-25T00:15:18.791ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4382025-01-25T00:15:18.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4392025-01-25T00:15:18.792ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4402025-01-25T00:15:18.793ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
4412025-01-25T00:15:18.793ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 379.876578ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
4422025-01-25T00:15:18.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4432025-01-25T00:15:18.797ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4442025-01-25T00:15:18.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4452025-01-25T00:15:18.805ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4462025-01-25T00:15:18.805ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1824fd5d-e3ee-4788-aa23-eb2685c2208c", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4472025-01-25T00:15:18.805ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4482025-01-25T00:15:18.806ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4492025-01-25T00:15:18.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4502025-01-25T00:15:18.807ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "937c5698-0fe4-4afa-aac2-ff79eef1af99", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4512025-01-25T00:15:18.807ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4522025-01-25T00:15:18.808ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4532025-01-25T00:15:18.809ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4542025-01-25T00:15:18.809ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 395.775831ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4552025-01-25T00:15:18.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4562025-01-25T00:15:18.816ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4572025-01-25T00:15:18.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4582025-01-25T00:15:18.824ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4592025-01-25T00:15:18.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4602025-01-25T00:15:18.827ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4612025-01-25T00:15:18.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4622025-01-25T00:15:18.830ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4632025-01-25T00:15:18.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4642025-01-25T00:15:18.831ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 417.777905ms iteration = 13 status = {"physical_disks_added":0}
4652025-01-25T00:15:18.832ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4662025-01-25T00:15:18.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4672025-01-25T00:15:18.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4682025-01-25T00:15:18.836ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4692025-01-25T00:15:18.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4702025-01-25T00:15:18.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4712025-01-25T00:15:18.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4722025-01-25T00:15:18.838ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4732025-01-25T00:15:18.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4742025-01-25T00:15:18.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4752025-01-25T00:15:18.841ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4762025-01-25T00:15:18.842ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4772025-01-25T00:15:18.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4782025-01-25T00:15:18.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4792025-01-25T00:15:18.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4802025-01-25T00:15:18.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4812025-01-25T00:15:18.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4822025-01-25T00:15:18.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4832025-01-25T00:15:18.848ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4842025-01-25T00:15:18.848ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4852025-01-25T00:15:18.849ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b68e5209-ada5-4d62-8f67-3f27a2bc2f49", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4862025-01-25T00:15:18.849ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4872025-01-25T00:15:18.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4882025-01-25T00:15:18.852ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "65f251d4-3f64-4cf4-9a4a-e68d44c1aaac", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4892025-01-25T00:15:18.852ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4902025-01-25T00:15:18.857ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "52610155-34ad-4c8d-8b5c-623a208b1c21", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4912025-01-25T00:15:18.857ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4922025-01-25T00:15:18.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4932025-01-25T00:15:18.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4942025-01-25T00:15:18.860ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4952025-01-25T00:15:18.861ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 447.54786ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4962025-01-25T00:15:18.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4972025-01-25T00:15:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4982025-01-25T00:15:18.866ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 452.651197ms iteration = 11 status = {}
4992025-01-25T00:15:18.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5002025-01-25T00:15:18.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5012025-01-25T00:15:18.939ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5022025-01-25T00:15:18.940ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "209948fd-9031-4fae-a7ae-593778535a4a", "content-length": "691", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
5032025-01-25T00:15:18.940ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
5042025-01-25T00:15:18.940ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
5052025-01-25T00:15:18.940ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
5062025-01-25T00:15:18.941ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5072025-01-25T00:15:18.941ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 528.229641ms iteration = 11 status = {}
5082025-01-25T00:15:18.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5092025-01-25T00:15:18.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5102025-01-25T00:15:18.947ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
5112025-01-25T00:15:18.947ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5122025-01-25T00:15:18.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5132025-01-25T00:15:18.948ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
5142025-01-25T00:15:18.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5152025-01-25T00:15:18.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5162025-01-25T00:15:18.951ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5172025-01-25T00:15:18.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5182025-01-25T00:15:18.960ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5192025-01-25T00:15:18.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5202025-01-25T00:15:18.962ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5212025-01-25T00:15:18.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
5222025-01-25T00:15:18.966ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5232025-01-25T00:15:18.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5242025-01-25T00:15:18.970ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
5252025-01-25T00:15:18.970ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "785ae703-12ff-4bb3-b1a4-578e4f986d0c", "content-length": "134", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
5262025-01-25T00:15:18.970ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
5272025-01-25T00:15:18.970ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
5282025-01-25T00:15:18.970ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5292025-01-25T00:15:18.970ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5302025-01-25T00:15:18.970ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5312025-01-25T00:15:18.970ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5322025-01-25T00:15:18.970ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5332025-01-25T00:15:18.970ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5342025-01-25T00:15:18.971ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5352025-01-25T00:15:18.971ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5362025-01-25T00:15:18.971ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
5372025-01-25T00:15:18.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5382025-01-25T00:15:18.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5392025-01-25T00:15:18.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5402025-01-25T00:15:18.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5412025-01-25T00:15:18.974ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5422025-01-25T00:15:18.974ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e46957fc-2907-43c7-93b8-573a5fadcc87", "content-length": "2", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
5432025-01-25T00:15:18.974ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5442025-01-25T00:15:18.974ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1daf355e-bfdb-4c44-9d6f-37b75348901d", "content-length": "52", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
5452025-01-25T00:15:18.974ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
5462025-01-25T00:15:18.974ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5472025-01-25T00:15:18.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5482025-01-25T00:15:18.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5492025-01-25T00:15:18.977ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5502025-01-25T00:15:18.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5512025-01-25T00:15:18.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5522025-01-25T00:15:18.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5532025-01-25T00:15:18.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5542025-01-25T00:15:18.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5552025-01-25T00:15:18.987ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5562025-01-25T00:15:18.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5572025-01-25T00:15:18.989ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5582025-01-25T00:15:18.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5592025-01-25T00:15:18.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602025-01-25T00:15:18.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
5612025-01-25T00:15:18.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5622025-01-25T00:15:18.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5632025-01-25T00:15:18.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5642025-01-25T00:15:18.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5652025-01-25T00:15:18.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5662025-01-25T00:15:18.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5672025-01-25T00:15:19.000ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5682025-01-25T00:15:19.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
5692025-01-25T00:15:19.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5702025-01-25T00:15:19.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5712025-01-25T00:15:19.023ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 3e7602ec-04be-4aee-8289-38cc36793714, kind: Service { id: 22685765-7656-499f-8835-1c19f38e16e6 }, name: Name("external-dns-22685765-7656-499f-8835-1c19f38e16e6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9177b433-e7bd-4285-a942-68884bcb366b, kind: Service { id: 68669e1f-c764-416e-9078-55cbc772328a }, name: Name("external-dns-68669e1f-c764-416e-9078-55cbc772328a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 145])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 25d62eb1-d2e8-4fc4-b282-46291224931e, kind: Service { id: af353237-4651-4023-8604-ee309f64048e }, name: Name("nexus-af353237-4651-4023-8604-ee309f64048e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3826f20-6642-4b59-81e8-ac53c0f47f3d, kind: Service { id: 8bff796d-a1b3-45c0-a35c-3cd6a40d03bc }, name: Name("nexus-8bff796d-a1b3-45c0-a35c-3cd6a40d03bc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed76ebe5-8c95-47b3-9c10-c2b972bb4743, kind: Service { id: fd38d148-0e8a-4c5e-af28-1c0123be0534 }, name: Name("nexus-fd38d148-0e8a-4c5e-af28-1c0123be0534"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 210])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
5722025-01-25T00:15:19.024ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5732025-01-25T00:15:19.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5742025-01-25T00:15:19.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5752025-01-25T00:15:19.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
5762025-01-25T00:15:19.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5772025-01-25T00:15:19.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5782025-01-25T00:15:19.029ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
5792025-01-25T00:15:19.031ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3e7602ec-04be-4aee-8289-38cc36793714, kind: Service { id: 22685765-7656-499f-8835-1c19f38e16e6 }, name: Name("external-dns-22685765-7656-499f-8835-1c19f38e16e6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9177b433-e7bd-4285-a942-68884bcb366b, kind: Service { id: 68669e1f-c764-416e-9078-55cbc772328a }, name: Name("external-dns-68669e1f-c764-416e-9078-55cbc772328a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 145])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 25d62eb1-d2e8-4fc4-b282-46291224931e, kind: Service { id: af353237-4651-4023-8604-ee309f64048e }, name: Name("nexus-af353237-4651-4023-8604-ee309f64048e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3826f20-6642-4b59-81e8-ac53c0f47f3d, kind: Service { id: 8bff796d-a1b3-45c0-a35c-3cd6a40d03bc }, name: Name("nexus-8bff796d-a1b3-45c0-a35c-3cd6a40d03bc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed76ebe5-8c95-47b3-9c10-c2b972bb4743, kind: Service { id: fd38d148-0e8a-4c5e-af28-1c0123be0534 }, name: Name("nexus-fd38d148-0e8a-4c5e-af28-1c0123be0534"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 210])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
5802025-01-25T00:15:19.031ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
5812025-01-25T00:15:19.091ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "03505fba-ef24-4b64-9c3a-f70f54302d9f", "date": "Sat, 25 Jan 2025 00:15:18 GMT"} })
5822025-01-25T00:15:19.091ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
5832025-01-25T00:15:19.091ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5842025-01-25T00:15:19.092ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e14ac82-6e10-42c8-9fd7-8696c55ad333", "content-length": "682", "date": "Sat, 25 Jan 2025 00:15:19 GMT"} })
5852025-01-25T00:15:19.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5862025-01-25T00:15:19.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5872025-01-25T00:15:19.093ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, time_created: 2025-01-25T00:10:44.486066Z, time_modified: 2025-01-25T00:10:44.486066Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
5882025-01-25T00:15:19.093ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
5892025-01-25T00:15:19.093ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5902025-01-25T00:15:19.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5912025-01-25T00:15:19.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5922025-01-25T00:15:19.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5932025-01-25T00:15:19.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5942025-01-25T00:15:19.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5952025-01-25T00:15:19.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5962025-01-25T00:15:19.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5972025-01-25T00:15:19.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
5982025-01-25T00:15:19.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5992025-01-25T00:15:19.102ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6002025-01-25T00:15:19.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6012025-01-25T00:15:19.110ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 697.301782ms iteration = 11 status = {}
6022025-01-25T00:15:19.137ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
6032025-01-25T00:15:19.139ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "02208696-0e23-4907-b6ef-7077dab969b3", "date": "Sat, 25 Jan 2025 00:15:19 GMT"} })
6042025-01-25T00:15:19.142ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
6052025-01-25T00:15:19.142ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 728.285493ms
6062025-01-25T00:15:19.142ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 728.295153ms iteration = 2 status = {}
6072025-01-25T00:15:19.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7bdb6c76-53fd-46c9-ad2f-be26ac42789b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6082025-01-25T00:15:19.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7bdb6c76-53fd-46c9-ad2f-be26ac42789b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6092025-01-25T00:15:19.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7bdb6c76-53fd-46c9-ad2f-be26ac42789b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6102025-01-25T00:15:19.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = a58f2b31-0f67-4ac8-9f3d-8dde4fcfc1ee roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
6112025-01-25T00:15:19.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = a58f2b31-0f67-4ac8-9f3d-8dde4fcfc1ee resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
6122025-01-25T00:15:19.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = a58f2b31-0f67-4ac8-9f3d-8dde4fcfc1ee response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
6132025-01-25T00:15:20.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4c4b9fdd-3563-45c7-9cd7-9107069925f7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6142025-01-25T00:15:20.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4c4b9fdd-3563-45c7-9cd7-9107069925f7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6152025-01-25T00:15:20.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4c4b9fdd-3563-45c7-9cd7-9107069925f7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6162025-01-25T00:15:20.977ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 6c75f4a4-3859-4adf-848e-bce1a2d474fd response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
6172025-01-25T00:15:21.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 55892ea8-644e-4300-9514-46cb15546e65 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6182025-01-25T00:15:21.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 55892ea8-644e-4300-9514-46cb15546e65 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6192025-01-25T00:15:21.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 55892ea8-644e-4300-9514-46cb15546e65 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6202025-01-25T00:15:22.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6c041f83-c5f9-4a0a-9481-630470c3072e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6212025-01-25T00:15:22.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6c041f83-c5f9-4a0a-9481-630470c3072e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6222025-01-25T00:15:22.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6c041f83-c5f9-4a0a-9481-630470c3072e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6232025-01-25T00:15:23.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08d10b7c-4cf2-414a-a733-46792b6aa588 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6242025-01-25T00:15:23.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08d10b7c-4cf2-414a-a733-46792b6aa588 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6252025-01-25T00:15:23.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08d10b7c-4cf2-414a-a733-46792b6aa588 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6262025-01-25T00:15:24.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c43f0833-76a2-4054-9b32-a91d240c0a87 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6272025-01-25T00:15:24.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c43f0833-76a2-4054-9b32-a91d240c0a87 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6282025-01-25T00:15:24.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c43f0833-76a2-4054-9b32-a91d240c0a87 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6292025-01-25T00:15:25.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0b377dfe-b3a1-4695-80af-85e21efa1155 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6302025-01-25T00:15:25.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0b377dfe-b3a1-4695-80af-85e21efa1155 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6312025-01-25T00:15:25.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0b377dfe-b3a1-4695-80af-85e21efa1155 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6322025-01-25T00:15:26.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e684cd96-5c7d-4e27-b3a7-95f46fff7f35 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6332025-01-25T00:15:26.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e684cd96-5c7d-4e27-b3a7-95f46fff7f35 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6342025-01-25T00:15:26.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e684cd96-5c7d-4e27-b3a7-95f46fff7f35 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6352025-01-25T00:15:27.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd5f1b8d-4645-4e15-bf0f-c106af33a18f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6362025-01-25T00:15:27.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd5f1b8d-4645-4e15-bf0f-c106af33a18f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6372025-01-25T00:15:27.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd5f1b8d-4645-4e15-bf0f-c106af33a18f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6382025-01-25T00:15:28.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8ea7f440-8728-4e54-a1a7-4c3314db5ff9 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6392025-01-25T00:15:28.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8ea7f440-8728-4e54-a1a7-4c3314db5ff9 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6402025-01-25T00:15:28.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8ea7f440-8728-4e54-a1a7-4c3314db5ff9 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6412025-01-25T00:15:28.413ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
6422025-01-25T00:15:28.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6432025-01-25T00:15:28.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6442025-01-25T00:15:28.413ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
6452025-01-25T00:15:28.413ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6462025-01-25T00:15:28.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6472025-01-25T00:15:28.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6482025-01-25T00:15:28.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6492025-01-25T00:15:28.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6502025-01-25T00:15:28.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6512025-01-25T00:15:28.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6522025-01-25T00:15:28.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6532025-01-25T00:15:28.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6542025-01-25T00:15:28.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
6552025-01-25T00:15:28.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6562025-01-25T00:15:28.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6572025-01-25T00:15:28.436ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
6582025-01-25T00:15:28.436ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.09536ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
6592025-01-25T00:15:28.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6602025-01-25T00:15:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6612025-01-25T00:15:28.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.500519ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6622025-01-25T00:15:29.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 73166f32-c40e-43e9-9295-5311e205de77 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6632025-01-25T00:15:29.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 73166f32-c40e-43e9-9295-5311e205de77 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6642025-01-25T00:15:29.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 73166f32-c40e-43e9-9295-5311e205de77 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6652025-01-25T00:15:30.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69b78e7f-aec8-44f2-944a-0075777b01d7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6662025-01-25T00:15:30.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69b78e7f-aec8-44f2-944a-0075777b01d7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6672025-01-25T00:15:30.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69b78e7f-aec8-44f2-944a-0075777b01d7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6682025-01-25T00:15:30.970ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:60784
6692025-01-25T00:15:30.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 2f46b4b7-1222-472a-9e27-928d3ca11b17 roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
6702025-01-25T00:15:30.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 2f46b4b7-1222-472a-9e27-928d3ca11b17 resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
6712025-01-25T00:15:30.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 2f46b4b7-1222-472a-9e27-928d3ca11b17 response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
6722025-01-25T00:15:30.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 4e4993b1-8783-4006-9630-bc363d621e4e roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
6732025-01-25T00:15:30.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 4e4993b1-8783-4006-9630-bc363d621e4e resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
6742025-01-25T00:15:30.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 4e4993b1-8783-4006-9630-bc363d621e4e response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
6752025-01-25T00:15:30.977ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 468 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = c97a84fd-b067-494e-87fc-38f4c4d86015 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
6762025-01-25T00:15:31.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a5de56db-1cb5-45fb-ab3d-914a9c378446 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6772025-01-25T00:15:31.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a5de56db-1cb5-45fb-ab3d-914a9c378446 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6782025-01-25T00:15:31.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a5de56db-1cb5-45fb-ab3d-914a9c378446 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6792025-01-25T00:15:32.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8187c873-b725-447b-854a-d5ef0786c942 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6802025-01-25T00:15:32.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8187c873-b725-447b-854a-d5ef0786c942 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6812025-01-25T00:15:32.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8187c873-b725-447b-854a-d5ef0786c942 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6822025-01-25T00:15:33.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c5096bb6-a54b-442f-97c8-81b6e66e0284 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6832025-01-25T00:15:33.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c5096bb6-a54b-442f-97c8-81b6e66e0284 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6842025-01-25T00:15:33.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c5096bb6-a54b-442f-97c8-81b6e66e0284 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6852025-01-25T00:15:34.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 05ddb27a-398b-4c1f-8a40-4bc2d436b947 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6862025-01-25T00:15:34.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 05ddb27a-398b-4c1f-8a40-4bc2d436b947 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6872025-01-25T00:15:34.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 05ddb27a-398b-4c1f-8a40-4bc2d436b947 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6882025-01-25T00:15:35.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c720c954-5f4a-48de-bb79-1e8e572e2951 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6892025-01-25T00:15:35.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c720c954-5f4a-48de-bb79-1e8e572e2951 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6902025-01-25T00:15:35.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c720c954-5f4a-48de-bb79-1e8e572e2951 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6912025-01-25T00:15:36.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7489ca5e-3d7f-490c-b4dd-a720bb75f898 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6922025-01-25T00:15:36.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7489ca5e-3d7f-490c-b4dd-a720bb75f898 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6932025-01-25T00:15:36.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7489ca5e-3d7f-490c-b4dd-a720bb75f898 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6942025-01-25T00:15:37.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0ad34c3-821a-48b3-af63-a0b0f1d9a7a2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6952025-01-25T00:15:37.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0ad34c3-821a-48b3-af63-a0b0f1d9a7a2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6962025-01-25T00:15:37.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0ad34c3-821a-48b3-af63-a0b0f1d9a7a2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
6972025-01-25T00:15:38.413ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
6982025-01-25T00:15:38.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6992025-01-25T00:15:38.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7002025-01-25T00:15:38.414ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
7012025-01-25T00:15:38.414ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7022025-01-25T00:15:38.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7032025-01-25T00:15:38.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7042025-01-25T00:15:38.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7052025-01-25T00:15:38.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7062025-01-25T00:15:38.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7072025-01-25T00:15:38.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7082025-01-25T00:15:38.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7092025-01-25T00:15:38.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7102025-01-25T00:15:38.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
7112025-01-25T00:15:38.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7122025-01-25T00:15:38.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7132025-01-25T00:15:38.436ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
7142025-01-25T00:15:38.436ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.356592ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
7152025-01-25T00:15:38.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7162025-01-25T00:15:38.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7172025-01-25T00:15:38.473ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.789376ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7182025-01-25T00:15:38.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 16fb5ace-4ece-4584-823d-b77c9977b64c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7192025-01-25T00:15:38.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 16fb5ace-4ece-4584-823d-b77c9977b64c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7202025-01-25T00:15:38.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1817 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 16fb5ace-4ece-4584-823d-b77c9977b64c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7212025-01-25T00:15:39.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 37032636-038a-4494-931b-4e44663473b1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7222025-01-25T00:15:39.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 37032636-038a-4494-931b-4e44663473b1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7232025-01-25T00:15:39.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 37032636-038a-4494-931b-4e44663473b1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7242025-01-25T00:15:40.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e1976634-4f0c-4854-bb2a-bdfe5f6f945a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7252025-01-25T00:15:40.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e1976634-4f0c-4854-bb2a-bdfe5f6f945a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7262025-01-25T00:15:40.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e1976634-4f0c-4854-bb2a-bdfe5f6f945a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7272025-01-25T00:15:40.977ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 558 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = e28f4875-0020-48be-90a3-694b8ceaf078 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
7282025-01-25T00:15:41.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4a504a3c-be18-4dc1-b30c-1de131dbe2ef roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7292025-01-25T00:15:41.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4a504a3c-be18-4dc1-b30c-1de131dbe2ef resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7302025-01-25T00:15:41.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4a504a3c-be18-4dc1-b30c-1de131dbe2ef response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7312025-01-25T00:15:42.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e8cbc2e7-1834-46e4-949f-8076f9c92815 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7322025-01-25T00:15:42.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e8cbc2e7-1834-46e4-949f-8076f9c92815 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7332025-01-25T00:15:42.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e8cbc2e7-1834-46e4-949f-8076f9c92815 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7342025-01-25T00:15:43.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8de89c16-b3cc-4cda-b2a6-213288d663c5 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7352025-01-25T00:15:43.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8de89c16-b3cc-4cda-b2a6-213288d663c5 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7362025-01-25T00:15:43.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8de89c16-b3cc-4cda-b2a6-213288d663c5 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7372025-01-25T00:15:44.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e6598c66-cefc-4095-9c92-5375fe66200c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7382025-01-25T00:15:44.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e6598c66-cefc-4095-9c92-5375fe66200c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7392025-01-25T00:15:44.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e6598c66-cefc-4095-9c92-5375fe66200c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7402025-01-25T00:15:45.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3ffde9d9-06ff-4263-8674-af0380147f97 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7412025-01-25T00:15:45.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3ffde9d9-06ff-4263-8674-af0380147f97 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7422025-01-25T00:15:45.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3ffde9d9-06ff-4263-8674-af0380147f97 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7432025-01-25T00:15:45.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 4ca0e751-c70d-4e54-b135-3f0234df42ef roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
7442025-01-25T00:15:45.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 4ca0e751-c70d-4e54-b135-3f0234df42ef resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
7452025-01-25T00:15:45.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 4ca0e751-c70d-4e54-b135-3f0234df42ef response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
7462025-01-25T00:15:45.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 1ac4e025-22c0-4dc1-bbcb-93e7b0a8b0b8 roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
7472025-01-25T00:15:45.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 1ac4e025-22c0-4dc1-bbcb-93e7b0a8b0b8 resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
7482025-01-25T00:15:45.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 1ac4e025-22c0-4dc1-bbcb-93e7b0a8b0b8 response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
7492025-01-25T00:15:46.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d6921819-1869-42c9-a5b6-c260bf62ac41 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7502025-01-25T00:15:46.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d6921819-1869-42c9-a5b6-c260bf62ac41 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7512025-01-25T00:15:46.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d6921819-1869-42c9-a5b6-c260bf62ac41 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7522025-01-25T00:15:47.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7da95c2a-f34c-4ddd-8349-a2f3bc141a19 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7532025-01-25T00:15:47.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7da95c2a-f34c-4ddd-8349-a2f3bc141a19 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7542025-01-25T00:15:47.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7da95c2a-f34c-4ddd-8349-a2f3bc141a19 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
7552025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
7562025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
7572025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7582025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
7592025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7602025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7612025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
7622025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7632025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
7642025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7652025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
7662025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7672025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
7682025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7692025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
7702025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
7712025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7722025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7732025-01-25T00:15:48.413ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
7742025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7752025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7762025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
7772025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7782025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7792025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7802025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
7812025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
7822025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
7832025-01-25T00:15:48.414ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
7842025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7852025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7862025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
7872025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7882025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7892025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7902025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
7912025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7922025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
7932025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
7942025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
7952025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7962025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7972025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
7982025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7992025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8002025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8012025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8022025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8032025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8042025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8052025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8062025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8072025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
8082025-01-25T00:15:48.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8092025-01-25T00:15:48.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8102025-01-25T00:15:48.416ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1271, tv_nsec: 142959340 } })
8112025-01-25T00:15:48.416ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
8122025-01-25T00:15:48.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8132025-01-25T00:15:48.417ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.693389ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
8142025-01-25T00:15:48.417ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1271, tv_nsec: 143693264 } })
8152025-01-25T00:15:48.417ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
8162025-01-25T00:15:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
8172025-01-25T00:15:48.418ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8182025-01-25T00:15:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8192025-01-25T00:15:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
8202025-01-25T00:15:48.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8212025-01-25T00:15:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8222025-01-25T00:15:48.419ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8232025-01-25T00:15:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8242025-01-25T00:15:48.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8252025-01-25T00:15:48.421ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8262025-01-25T00:15:48.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8272025-01-25T00:15:48.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.872681ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
8282025-01-25T00:15:48.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8292025-01-25T00:15:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8302025-01-25T00:15:48.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8312025-01-25T00:15:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8322025-01-25T00:15:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8332025-01-25T00:15:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8342025-01-25T00:15:48.423ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8352025-01-25T00:15:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8362025-01-25T00:15:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8372025-01-25T00:15:48.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8382025-01-25T00:15:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8392025-01-25T00:15:48.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8402025-01-25T00:15:48.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.792302ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
8412025-01-25T00:15:48.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8422025-01-25T00:15:48.428ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8432025-01-25T00:15:48.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8442025-01-25T00:15:48.429ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8452025-01-25T00:15:48.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8462025-01-25T00:15:48.430ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1271, tv_nsec: 156952063 } })
8472025-01-25T00:15:48.431ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
8482025-01-25T00:15:48.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
8492025-01-25T00:15:48.431ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8502025-01-25T00:15:48.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8512025-01-25T00:15:48.431ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8522025-01-25T00:15:48.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8532025-01-25T00:15:48.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8542025-01-25T00:15:48.433ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.561372ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8552025-01-25T00:15:48.434ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8562025-01-25T00:15:48.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8572025-01-25T00:15:48.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8582025-01-25T00:15:48.435ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8592025-01-25T00:15:48.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 21.09994ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8602025-01-25T00:15:48.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8612025-01-25T00:15:48.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8622025-01-25T00:15:48.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8632025-01-25T00:15:48.442ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8642025-01-25T00:15:48.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8652025-01-25T00:15:48.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8662025-01-25T00:15:48.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8672025-01-25T00:15:48.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8682025-01-25T00:15:48.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8692025-01-25T00:15:48.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8702025-01-25T00:15:48.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8712025-01-25T00:15:48.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8722025-01-25T00:15:48.447ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8732025-01-25T00:15:48.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8742025-01-25T00:15:48.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8752025-01-25T00:15:48.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
8762025-01-25T00:15:48.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8772025-01-25T00:15:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8782025-01-25T00:15:48.475ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8792025-01-25T00:15:48.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8802025-01-25T00:15:48.477ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
8812025-01-25T00:15:48.477ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.647461ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
8822025-01-25T00:15:48.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8832025-01-25T00:15:48.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8842025-01-25T00:15:48.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8852025-01-25T00:15:48.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8862025-01-25T00:15:48.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8872025-01-25T00:15:48.486ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8882025-01-25T00:15:48.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8892025-01-25T00:15:48.488ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8902025-01-25T00:15:48.488ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
8912025-01-25T00:15:48.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8922025-01-25T00:15:48.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8932025-01-25T00:15:48.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
8942025-01-25T00:15:48.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8952025-01-25T00:15:48.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8962025-01-25T00:15:48.491ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 78.198827ms iteration = 12 status = 0
8972025-01-25T00:15:48.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.490295ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8982025-01-25T00:15:48.501ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
8992025-01-25T00:15:48.501ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 88.22551ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
9002025-01-25T00:15:48.503ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
9012025-01-25T00:15:48.503ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.990874ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
9022025-01-25T00:15:48.516ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 103.303998ms iteration = 14 status = {"physical_disks_added":0}
9032025-01-25T00:15:48.527ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9042025-01-25T00:15:48.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9052025-01-25T00:15:48.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9062025-01-25T00:15:48.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9072025-01-25T00:15:48.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9082025-01-25T00:15:48.533ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9092025-01-25T00:15:48.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9102025-01-25T00:15:48.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9112025-01-25T00:15:48.534ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9122025-01-25T00:15:48.534ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
9132025-01-25T00:15:48.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9142025-01-25T00:15:48.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9152025-01-25T00:15:48.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9162025-01-25T00:15:48.536ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
9172025-01-25T00:15:48.536ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9182025-01-25T00:15:48.536ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b051d9ad-0da4-4468-b763-a375383f8705", "content-length": "26", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9192025-01-25T00:15:48.536ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9202025-01-25T00:15:48.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9212025-01-25T00:15:48.537ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9222025-01-25T00:15:48.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9232025-01-25T00:15:48.538ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
9242025-01-25T00:15:48.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 155.56301ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
9252025-01-25T00:15:48.569ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9262025-01-25T00:15:48.569ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
9272025-01-25T00:15:48.569ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 155.60391ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
9282025-01-25T00:15:48.573ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
9292025-01-25T00:15:48.573ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9302025-01-25T00:15:48.573ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cee289e-71b5-4b78-8cbf-adc63f928a4b", "content-length": "26", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9312025-01-25T00:15:48.573ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9322025-01-25T00:15:48.575ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9332025-01-25T00:15:48.614ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
9342025-01-25T00:15:48.614ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9352025-01-25T00:15:48.615ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6937c4a1-a12c-4dab-919a-2de546bd0abf", "content-length": "26", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9362025-01-25T00:15:48.615ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9372025-01-25T00:15:48.617ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9382025-01-25T00:15:48.693ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
9392025-01-25T00:15:48.693ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9402025-01-25T00:15:48.693ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccf4782d-60cb-4aca-9502-270e40c78ba6", "content-length": "372", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9412025-01-25T00:15:48.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9422025-01-25T00:15:48.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9432025-01-25T00:15:48.713ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 300.317704ms iteration = 12 status = {}
9442025-01-25T00:15:48.737ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
9452025-01-25T00:15:48.738ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9462025-01-25T00:15:48.738ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3488e199-6821-43ce-8d5c-3fd4bc9e83de", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9472025-01-25T00:15:48.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9482025-01-25T00:15:48.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9492025-01-25T00:15:48.739ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9502025-01-25T00:15:48.739ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "19ed2516-b500-422d-abc0-fbd6cc65568f", "content-length": "691", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9512025-01-25T00:15:48.739ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
9522025-01-25T00:15:48.739ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
9532025-01-25T00:15:48.739ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
9542025-01-25T00:15:48.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9552025-01-25T00:15:48.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9562025-01-25T00:15:48.740ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 327.254804ms iteration = 12 status = {}
9572025-01-25T00:15:48.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9582025-01-25T00:15:48.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9592025-01-25T00:15:48.746ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9602025-01-25T00:15:48.746ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9612025-01-25T00:15:48.747ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9d2f9470-4038-411c-9191-39ef8a8dc19b", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9622025-01-25T00:15:48.748ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 334.525492ms iteration = 12 status = {}
9632025-01-25T00:15:48.770ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
9642025-01-25T00:15:48.770ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "410e29b9-2bdd-48cd-8ae6-e4859d1e6846", "content-length": "1", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9652025-01-25T00:15:48.771ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9662025-01-25T00:15:48.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9672025-01-25T00:15:48.773ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 360.254376ms iteration = 12 status = null
9682025-01-25T00:15:48.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9692025-01-25T00:15:48.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9702025-01-25T00:15:48.804ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
9712025-01-25T00:15:48.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9722025-01-25T00:15:48.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9732025-01-25T00:15:48.812ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
9742025-01-25T00:15:48.813ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9bcf8ed-8567-436d-9644-b47916865209", "content-length": "134", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9752025-01-25T00:15:48.813ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
9762025-01-25T00:15:48.813ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
9772025-01-25T00:15:48.813ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
9782025-01-25T00:15:48.813ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9792025-01-25T00:15:48.813ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9802025-01-25T00:15:48.813ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9812025-01-25T00:15:48.813ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9822025-01-25T00:15:48.813ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9832025-01-25T00:15:48.813ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9842025-01-25T00:15:48.813ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9852025-01-25T00:15:48.814ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
9862025-01-25T00:15:48.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9872025-01-25T00:15:48.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9882025-01-25T00:15:48.816ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9892025-01-25T00:15:48.816ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f051626-2545-4e1d-a4de-38b96d11e9ea", "content-length": "2", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9902025-01-25T00:15:48.816ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9912025-01-25T00:15:48.816ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8590e29c-668e-406c-b66b-845a934e9bec", "content-length": "52", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9922025-01-25T00:15:48.816ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
9932025-01-25T00:15:48.816ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9942025-01-25T00:15:48.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9f4381f6-60d1-4aee-b113-44dea7663907 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
9952025-01-25T00:15:48.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9f4381f6-60d1-4aee-b113-44dea7663907 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
9962025-01-25T00:15:48.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9f4381f6-60d1-4aee-b113-44dea7663907 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
9972025-01-25T00:15:49.011ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "72fb82cd-2317-401b-8066-5539083963fa", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
9982025-01-25T00:15:49.011ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
9992025-01-25T00:15:49.011ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
10002025-01-25T00:15:49.011ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "82a51f47-78b8-4467-a36c-6dbaebe51586", "content-length": "682", "date": "Sat, 25 Jan 2025 00:15:48 GMT"} })
10012025-01-25T00:15:49.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10022025-01-25T00:15:49.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10032025-01-25T00:15:49.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10042025-01-25T00:15:49.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10052025-01-25T00:15:49.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10062025-01-25T00:15:49.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10072025-01-25T00:15:49.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10082025-01-25T00:15:49.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10092025-01-25T00:15:49.029ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 615.521875ms iteration = 12 status = {}
10102025-01-25T00:15:49.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 3f7a1fa8-c493-450c-a4f4-eab11472f6f3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
10112025-01-25T00:15:49.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 3f7a1fa8-c493-450c-a4f4-eab11472f6f3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
10122025-01-25T00:15:49.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 3f7a1fa8-c493-450c-a4f4-eab11472f6f3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
10132025-01-25T00:15:49.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08876cc3-7980-4746-afca-b7c863cb1291 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10142025-01-25T00:15:49.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08876cc3-7980-4746-afca-b7c863cb1291 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10152025-01-25T00:15:49.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08876cc3-7980-4746-afca-b7c863cb1291 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10162025-01-25T00:15:50.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4b032017-9634-40d5-929e-c0c6c656874c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10172025-01-25T00:15:50.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4b032017-9634-40d5-929e-c0c6c656874c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10182025-01-25T00:15:50.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4b032017-9634-40d5-929e-c0c6c656874c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10192025-01-25T00:15:50.977ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 580 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = c23afe86-e25f-4529-b4b6-08bc910f53ef response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
10202025-01-25T00:15:51.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c30e9c1-73f8-4873-b88c-81f49348fae1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10212025-01-25T00:15:51.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c30e9c1-73f8-4873-b88c-81f49348fae1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10222025-01-25T00:15:51.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c30e9c1-73f8-4873-b88c-81f49348fae1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10232025-01-25T00:15:52.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1e014fac-1488-469e-b40e-900d9f6ec463 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10242025-01-25T00:15:52.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1e014fac-1488-469e-b40e-900d9f6ec463 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10252025-01-25T00:15:52.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1e014fac-1488-469e-b40e-900d9f6ec463 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10262025-01-25T00:15:54.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f353e8f7-4c81-4ed9-9938-2476d9a6f098 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10272025-01-25T00:15:54.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f353e8f7-4c81-4ed9-9938-2476d9a6f098 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10282025-01-25T00:15:54.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f353e8f7-4c81-4ed9-9938-2476d9a6f098 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10292025-01-25T00:15:55.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d6d56575-21f5-48b6-89c0-c3e0f88ecc50 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10302025-01-25T00:15:55.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d6d56575-21f5-48b6-89c0-c3e0f88ecc50 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10312025-01-25T00:15:55.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d6d56575-21f5-48b6-89c0-c3e0f88ecc50 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10322025-01-25T00:15:56.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c174cf07-7f50-4e9d-bd7a-45db188e7ef1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10332025-01-25T00:15:56.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c174cf07-7f50-4e9d-bd7a-45db188e7ef1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10342025-01-25T00:15:56.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c174cf07-7f50-4e9d-bd7a-45db188e7ef1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10352025-01-25T00:15:57.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7942d96e-bb8f-42bc-982a-871bc46bcc88 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10362025-01-25T00:15:57.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7942d96e-bb8f-42bc-982a-871bc46bcc88 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10372025-01-25T00:15:57.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7942d96e-bb8f-42bc-982a-871bc46bcc88 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10382025-01-25T00:15:58.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 21b3983c-f955-4f5f-9970-1c6850deb654 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10392025-01-25T00:15:58.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 21b3983c-f955-4f5f-9970-1c6850deb654 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10402025-01-25T00:15:58.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 21b3983c-f955-4f5f-9970-1c6850deb654 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10412025-01-25T00:15:58.413ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
10422025-01-25T00:15:58.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10432025-01-25T00:15:58.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10442025-01-25T00:15:58.414ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
10452025-01-25T00:15:58.414ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10462025-01-25T00:15:58.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10472025-01-25T00:15:58.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10482025-01-25T00:15:58.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10492025-01-25T00:15:58.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10502025-01-25T00:15:58.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.573279ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10512025-01-25T00:15:58.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10522025-01-25T00:15:58.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10532025-01-25T00:15:58.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10542025-01-25T00:15:58.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10552025-01-25T00:15:58.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10562025-01-25T00:15:58.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10572025-01-25T00:15:58.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
10582025-01-25T00:15:58.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10592025-01-25T00:15:58.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10602025-01-25T00:15:58.433ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
10612025-01-25T00:15:58.433ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.809183ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
10622025-01-25T00:15:59.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08deffb0-e98d-4e10-abf1-6478dcd6d0a6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10632025-01-25T00:15:59.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08deffb0-e98d-4e10-abf1-6478dcd6d0a6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10642025-01-25T00:15:59.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08deffb0-e98d-4e10-abf1-6478dcd6d0a6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10652025-01-25T00:16:00.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b81739f-6cf3-41a4-a148-a12b267b1f32 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10662025-01-25T00:16:00.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b81739f-6cf3-41a4-a148-a12b267b1f32 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10672025-01-25T00:16:00.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b81739f-6cf3-41a4-a148-a12b267b1f32 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10682025-01-25T00:16:00.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 04d5e2f7-8db4-4f5e-b560-62df56c9d931 roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
10692025-01-25T00:16:00.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 04d5e2f7-8db4-4f5e-b560-62df56c9d931 resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
10702025-01-25T00:16:00.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 04d5e2f7-8db4-4f5e-b560-62df56c9d931 response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
10712025-01-25T00:16:00.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 057b62c3-8890-4220-b66e-2e66f8edd4cd roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
10722025-01-25T00:16:00.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 057b62c3-8890-4220-b66e-2e66f8edd4cd resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
10732025-01-25T00:16:00.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2636 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 057b62c3-8890-4220-b66e-2e66f8edd4cd response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
10742025-01-25T00:16:00.977ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 456 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = d9197d6f-cdd2-4fc8-8dcc-b3e1d33f9e1b response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
10752025-01-25T00:16:01.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 31bb9ade-6f63-40af-a531-93381f38667f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10762025-01-25T00:16:01.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 31bb9ade-6f63-40af-a531-93381f38667f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10772025-01-25T00:16:01.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 31bb9ade-6f63-40af-a531-93381f38667f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10782025-01-25T00:16:02.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 68aa04d1-d0de-48bf-b7e1-ea9e88b0a816 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10792025-01-25T00:16:02.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 68aa04d1-d0de-48bf-b7e1-ea9e88b0a816 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10802025-01-25T00:16:02.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 68aa04d1-d0de-48bf-b7e1-ea9e88b0a816 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10812025-01-25T00:16:03.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c1d7a029-5053-42f2-bdc7-2f9da87d0ff8 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10822025-01-25T00:16:03.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c1d7a029-5053-42f2-bdc7-2f9da87d0ff8 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10832025-01-25T00:16:03.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c1d7a029-5053-42f2-bdc7-2f9da87d0ff8 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10842025-01-25T00:16:04.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5f0add35-1e58-43ab-a382-f7d0e289c321 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10852025-01-25T00:16:04.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5f0add35-1e58-43ab-a382-f7d0e289c321 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10862025-01-25T00:16:04.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5f0add35-1e58-43ab-a382-f7d0e289c321 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10872025-01-25T00:16:05.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 670525f5-4abb-4ba7-a72b-b97b55d5eca1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10882025-01-25T00:16:05.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 670525f5-4abb-4ba7-a72b-b97b55d5eca1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10892025-01-25T00:16:05.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 670525f5-4abb-4ba7-a72b-b97b55d5eca1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10902025-01-25T00:16:06.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ebe3206f-8b7f-42e6-bff7-4920a3756eda roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10912025-01-25T00:16:06.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ebe3206f-8b7f-42e6-bff7-4920a3756eda resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10922025-01-25T00:16:06.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ebe3206f-8b7f-42e6-bff7-4920a3756eda response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10932025-01-25T00:16:07.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8d788913-18c7-47c5-904f-95594e71245d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10942025-01-25T00:16:07.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8d788913-18c7-47c5-904f-95594e71245d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10952025-01-25T00:16:07.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2735 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8d788913-18c7-47c5-904f-95594e71245d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10962025-01-25T00:16:08.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d05e465b-0905-49a4-9a13-2ec3a6e7516d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10972025-01-25T00:16:08.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d05e465b-0905-49a4-9a13-2ec3a6e7516d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10982025-01-25T00:16:08.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d05e465b-0905-49a4-9a13-2ec3a6e7516d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
10992025-01-25T00:16:08.413ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
11002025-01-25T00:16:08.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11012025-01-25T00:16:08.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11022025-01-25T00:16:08.415ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
11032025-01-25T00:16:08.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11042025-01-25T00:16:08.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11052025-01-25T00:16:08.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11062025-01-25T00:16:08.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11072025-01-25T00:16:08.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11082025-01-25T00:16:08.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11092025-01-25T00:16:08.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11102025-01-25T00:16:08.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11112025-01-25T00:16:08.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.450288ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11122025-01-25T00:16:08.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11132025-01-25T00:16:08.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11142025-01-25T00:16:08.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11152025-01-25T00:16:08.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
11162025-01-25T00:16:08.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11172025-01-25T00:16:08.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11182025-01-25T00:16:08.433ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
11192025-01-25T00:16:08.433ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.939294ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
11202025-01-25T00:16:09.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9eb8cf7e-fece-4058-8da6-8b088bb933a6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11212025-01-25T00:16:09.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9eb8cf7e-fece-4058-8da6-8b088bb933a6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11222025-01-25T00:16:09.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9eb8cf7e-fece-4058-8da6-8b088bb933a6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11232025-01-25T00:16:10.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1d139c0b-8b47-457f-9063-13576cb55f79 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11242025-01-25T00:16:10.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1d139c0b-8b47-457f-9063-13576cb55f79 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11252025-01-25T00:16:10.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1d139c0b-8b47-457f-9063-13576cb55f79 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11262025-01-25T00:16:10.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 545 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = a6d9e286-99f7-4dd0-81f8-26e37a0fe6bc response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
11272025-01-25T00:16:11.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ff7824f1-609b-4c30-b43d-5f38f9dbe24a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11282025-01-25T00:16:11.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ff7824f1-609b-4c30-b43d-5f38f9dbe24a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11292025-01-25T00:16:11.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ff7824f1-609b-4c30-b43d-5f38f9dbe24a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11302025-01-25T00:16:12.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3e4fea49-186c-4689-9ac7-f61a3623f3cf roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11312025-01-25T00:16:12.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3e4fea49-186c-4689-9ac7-f61a3623f3cf resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11322025-01-25T00:16:12.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3e4fea49-186c-4689-9ac7-f61a3623f3cf response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11332025-01-25T00:16:13.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c28fb76b-5ca2-455d-909e-f34884a221e4 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11342025-01-25T00:16:13.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c28fb76b-5ca2-455d-909e-f34884a221e4 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11352025-01-25T00:16:13.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c28fb76b-5ca2-455d-909e-f34884a221e4 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11362025-01-25T00:16:14.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c69acbdf-2eda-4038-ad5e-bedea473bdc1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11372025-01-25T00:16:14.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c69acbdf-2eda-4038-ad5e-bedea473bdc1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11382025-01-25T00:16:14.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c69acbdf-2eda-4038-ad5e-bedea473bdc1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11392025-01-25T00:16:15.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1df72afd-8389-409f-9c68-ef5998de57ab roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11402025-01-25T00:16:15.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1df72afd-8389-409f-9c68-ef5998de57ab resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11412025-01-25T00:16:15.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1df72afd-8389-409f-9c68-ef5998de57ab response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11422025-01-25T00:16:16.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 651cc028-14b9-4f6c-bb64-e82bfb389ab7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11432025-01-25T00:16:16.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 651cc028-14b9-4f6c-bb64-e82bfb389ab7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11442025-01-25T00:16:16.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 651cc028-14b9-4f6c-bb64-e82bfb389ab7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11452025-01-25T00:16:17.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6d571806-1240-4430-ac5f-d3ccc4f53e2c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11462025-01-25T00:16:17.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6d571806-1240-4430-ac5f-d3ccc4f53e2c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11472025-01-25T00:16:17.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6d571806-1240-4430-ac5f-d3ccc4f53e2c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
11482025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
11492025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
11502025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
11512025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11522025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
11532025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11542025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
11552025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
11562025-01-25T00:16:18.414ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-25 00:06:18.414322663 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
11572025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
11582025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
11592025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11602025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
11612025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11622025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
11632025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11642025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
11652025-01-25T00:16:18.414ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2
11662025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.09\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2"}
11672025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
11682025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
11692025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11702025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
11712025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
11722025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11732025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
11742025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
11752025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11762025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
11772025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11782025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
11792025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11802025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11812025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
11822025-01-25T00:16:18.414ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
11832025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
11842025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11852025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11862025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
11872025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
11882025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
11892025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11902025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
11912025-01-25T00:16:18.414ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
11922025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
11932025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11942025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11952025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
11962025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
11972025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11982025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
11992025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
12002025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
12012025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
12022025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
12032025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12042025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12052025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
12062025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
12072025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12082025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12092025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
12102025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12112025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
12122025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12132025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12142025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
12152025-01-25T00:16:18.414ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
12162025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12172025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12182025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
12192025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12202025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12212025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
12222025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12232025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12242025-01-25T00:16:18.415ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22685765-7656-499f-8835-1c19f38e16e6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1301, tv_nsec: 140770348 } })
12252025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12262025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12272025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12282025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12292025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12302025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12312025-01-25T00:16:18.415ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("167a4f68-f407-48e5-a9a6-22f96a22bf2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3a6aa3c-ea79-4881-9aa5-b12ba496f837.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1301, tv_nsec: 140926249 } })
12322025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12332025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12342025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12352025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12362025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12372025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12382025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12392025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12402025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
12412025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
12422025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12432025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12442025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12452025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
12462025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.217316ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
12472025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12482025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12492025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
12502025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.216417ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
12512025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12522025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12532025-01-25T00:16:18.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12542025-01-25T00:16:18.416ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1301, tv_nsec: 142367217 } })
12552025-01-25T00:16:18.416ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
12562025-01-25T00:16:18.417ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.878805ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12572025-01-25T00:16:18.417ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1301, tv_nsec: 143088940 } })
12582025-01-25T00:16:18.417ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
12592025-01-25T00:16:18.418ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12602025-01-25T00:16:18.418ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-25 00:06:18.414322663 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
12612025-01-25T00:16:18.418ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.232311ms iteration = 7 status = {"expiration":"2025-01-25T00:06:18.414322663Z","pruned":[]}
12622025-01-25T00:16:18.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12632025-01-25T00:16:18.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12642025-01-25T00:16:18.420ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12652025-01-25T00:16:18.420ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12662025-01-25T00:16:18.420ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12672025-01-25T00:16:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12682025-01-25T00:16:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12692025-01-25T00:16:18.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12702025-01-25T00:16:18.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12712025-01-25T00:16:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12722025-01-25T00:16:18.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12732025-01-25T00:16:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12742025-01-25T00:16:18.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12752025-01-25T00:16:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12762025-01-25T00:16:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12772025-01-25T00:16:18.423ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12782025-01-25T00:16:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12792025-01-25T00:16:18.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12802025-01-25T00:16:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12812025-01-25T00:16:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12822025-01-25T00:16:18.424ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12832025-01-25T00:16:18.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12842025-01-25T00:16:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12852025-01-25T00:16:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12862025-01-25T00:16:18.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12872025-01-25T00:16:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12882025-01-25T00:16:18.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12892025-01-25T00:16:18.426ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12902025-01-25T00:16:18.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12912025-01-25T00:16:18.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12922025-01-25T00:16:18.428ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12932025-01-25T00:16:18.428ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12942025-01-25T00:16:18.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12952025-01-25T00:16:18.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12962025-01-25T00:16:18.429ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12972025-01-25T00:16:18.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12982025-01-25T00:16:18.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12992025-01-25T00:16:18.429ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13002025-01-25T00:16:18.430ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13012025-01-25T00:16:18.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
13022025-01-25T00:16:18.431ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13032025-01-25T00:16:18.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
13042025-01-25T00:16:18.432ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13052025-01-25T00:16:18.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
13062025-01-25T00:16:18.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13072025-01-25T00:16:18.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13082025-01-25T00:16:18.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13092025-01-25T00:16:18.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13102025-01-25T00:16:18.437ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13112025-01-25T00:16:18.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13122025-01-25T00:16:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13132025-01-25T00:16:18.439ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13142025-01-25T00:16:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13152025-01-25T00:16:18.440ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13162025-01-25T00:16:18.440ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
13172025-01-25T00:16:18.440ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
13182025-01-25T00:16:18.440ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 25.595264ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
13192025-01-25T00:16:18.440ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.669204ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
13202025-01-25T00:16:18.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13212025-01-25T00:16:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13222025-01-25T00:16:18.442ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13232025-01-25T00:16:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13242025-01-25T00:16:18.443ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13252025-01-25T00:16:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13262025-01-25T00:16:18.445ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13272025-01-25T00:16:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13282025-01-25T00:16:18.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13292025-01-25T00:16:18.447ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13302025-01-25T00:16:18.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13312025-01-25T00:16:18.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13322025-01-25T00:16:18.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13332025-01-25T00:16:18.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13342025-01-25T00:16:18.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13352025-01-25T00:16:18.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13362025-01-25T00:16:18.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13372025-01-25T00:16:18.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13382025-01-25T00:16:18.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13392025-01-25T00:16:18.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13402025-01-25T00:16:18.457ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1301, tv_nsec: 183577011 } })
13412025-01-25T00:16:18.458ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
13422025-01-25T00:16:18.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13432025-01-25T00:16:18.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13442025-01-25T00:16:18.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13452025-01-25T00:16:18.465ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.303562ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13462025-01-25T00:16:18.466ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13472025-01-25T00:16:18.469ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13482025-01-25T00:16:18.469ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13492025-01-25T00:16:18.469ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13502025-01-25T00:16:18.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13512025-01-25T00:16:18.469ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13522025-01-25T00:16:18.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13532025-01-25T00:16:18.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13542025-01-25T00:16:18.471ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13552025-01-25T00:16:18.471ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.136267ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13562025-01-25T00:16:18.474ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13572025-01-25T00:16:18.476ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13582025-01-25T00:16:18.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13592025-01-25T00:16:18.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13602025-01-25T00:16:18.477ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13612025-01-25T00:16:18.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13622025-01-25T00:16:18.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
13632025-01-25T00:16:18.480ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13642025-01-25T00:16:18.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13652025-01-25T00:16:18.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13662025-01-25T00:16:18.480ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13672025-01-25T00:16:18.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13682025-01-25T00:16:18.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.491064ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
13692025-01-25T00:16:18.490ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13702025-01-25T00:16:18.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13712025-01-25T00:16:18.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13722025-01-25T00:16:18.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13732025-01-25T00:16:18.494ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13742025-01-25T00:16:18.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13752025-01-25T00:16:18.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 81.360583ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
13762025-01-25T00:16:18.502ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13772025-01-25T00:16:18.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13782025-01-25T00:16:18.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.961325ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13792025-01-25T00:16:18.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13802025-01-25T00:16:18.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13812025-01-25T00:16:18.517ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
13822025-01-25T00:16:18.517ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
13832025-01-25T00:16:18.517ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
13842025-01-25T00:16:18.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13852025-01-25T00:16:18.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13862025-01-25T00:16:18.520ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
13872025-01-25T00:16:18.520ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
13882025-01-25T00:16:18.520ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
13892025-01-25T00:16:18.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13902025-01-25T00:16:18.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13912025-01-25T00:16:18.522ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
13922025-01-25T00:16:18.522ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
13932025-01-25T00:16:18.522ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 108.010602ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
13942025-01-25T00:16:18.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 616f3c8b-27d3-449a-b067-1a5b06378ebe roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
13952025-01-25T00:16:18.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 616f3c8b-27d3-449a-b067-1a5b06378ebe resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
13962025-01-25T00:16:18.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13972025-01-25T00:16:18.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13982025-01-25T00:16:18.569ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
13992025-01-25T00:16:18.569ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14002025-01-25T00:16:18.569ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a9e0c2c-f059-4d55-9989-a0cbb0c06a33", "content-length": "26", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} })
14012025-01-25T00:16:18.569ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14022025-01-25T00:16:18.571ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14032025-01-25T00:16:18.594ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
14042025-01-25T00:16:18.610ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14052025-01-25T00:16:18.614ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
14062025-01-25T00:16:18.614ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 199.81392ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
14072025-01-25T00:16:18.622ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
14082025-01-25T00:16:18.622ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14092025-01-25T00:16:18.622ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e076812-5a46-40d1-ad9c-51752a5af52c", "content-length": "26", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} })
14102025-01-25T00:16:18.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14112025-01-25T00:16:18.623ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14122025-01-25T00:16:18.664ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
14132025-01-25T00:16:18.664ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14142025-01-25T00:16:18.664ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b637bd43-6211-4599-be86-6e4170a74374", "content-length": "26", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} })
14152025-01-25T00:16:18.664ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14162025-01-25T00:16:18.666ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
14172025-01-25T00:16:18.735ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14182025-01-25T00:16:18.736ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14192025-01-25T00:16:18.736ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9a503bd-f162-4fc4-96f8-d4beea108361", "content-length": "372", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} })
14202025-01-25T00:16:18.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14212025-01-25T00:16:18.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14222025-01-25T00:16:18.741ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 326.690911ms iteration = 4 status = {"nsuccess":5}
14232025-01-25T00:16:18.742ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14242025-01-25T00:16:18.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14252025-01-25T00:16:18.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 616f3c8b-27d3-449a-b067-1a5b06378ebe response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
14262025-01-25T00:16:18.763ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
14272025-01-25T00:16:18.763ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 349.108248ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
14282025-01-25T00:16:18.782ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14292025-01-25T00:16:18.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14302025-01-25T00:16:18.787ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14312025-01-25T00:16:18.787ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14322025-01-25T00:16:18.787ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 372.338309ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14332025-01-25T00:16:18.787ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14342025-01-25T00:16:18.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14352025-01-25T00:16:18.787ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14362025-01-25T00:16:18.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14372025-01-25T00:16:18.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14382025-01-25T00:16:18.789ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14392025-01-25T00:16:18.791ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
14402025-01-25T00:16:18.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
14412025-01-25T00:16:18.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14422025-01-25T00:16:18.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14432025-01-25T00:16:18.792ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6db88d7d-e9ed-4854-98af-6e8876fc5192", "content-length": "1", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} })
14442025-01-25T00:16:18.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
14452025-01-25T00:16:18.793ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14462025-01-25T00:16:18.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14472025-01-25T00:16:18.793ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14482025-01-25T00:16:18.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14492025-01-25T00:16:18.794ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 380.125079ms iteration = 13 status = 0
14502025-01-25T00:16:18.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 382.784763ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14512025-01-25T00:16:18.799ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 385.001625ms iteration = 13 status = null
14522025-01-25T00:16:18.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14532025-01-25T00:16:18.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14542025-01-25T00:16:18.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14552025-01-25T00:16:18.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14562025-01-25T00:16:18.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14572025-01-25T00:16:18.806ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
14582025-01-25T00:16:18.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14592025-01-25T00:16:18.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14602025-01-25T00:16:18.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14612025-01-25T00:16:18.815ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
14622025-01-25T00:16:18.815ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
14632025-01-25T00:16:18.815ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7abcdd78-5143-4fd6-9aa2-3c63cab3a8c3", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} })
14642025-01-25T00:16:18.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14652025-01-25T00:16:18.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14662025-01-25T00:16:18.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 410.94426ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14672025-01-25T00:16:18.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14682025-01-25T00:16:18.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14692025-01-25T00:16:18.835ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 421.356574ms iteration = 13 status = {}
14702025-01-25T00:16:18.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14712025-01-25T00:16:18.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14722025-01-25T00:16:18.840ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14732025-01-25T00:16:18.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14742025-01-25T00:16:18.842ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14752025-01-25T00:16:18.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14762025-01-25T00:16:18.844ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
14772025-01-25T00:16:18.844ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 429.730147ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
14782025-01-25T00:16:18.853ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14792025-01-25T00:16:18.853ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14802025-01-25T00:16:18.853ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6a91f411-8bd8-4afb-8904-522321f9eb34", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} })
14812025-01-25T00:16:18.855ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
14822025-01-25T00:16:18.855ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 0 version = 2
14832025-01-25T00:16:18.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14842025-01-25T00:16:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14852025-01-25T00:16:18.856ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 441.421339ms iteration = 13 status = {}
14862025-01-25T00:16:18.861ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14872025-01-25T00:16:18.861ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14882025-01-25T00:16:18.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14892025-01-25T00:16:18.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14902025-01-25T00:16:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14912025-01-25T00:16:18.864ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
14922025-01-25T00:16:18.864ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "91398695-c7b9-4ec8-b2f5-375796704899", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14932025-01-25T00:16:18.864ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14942025-01-25T00:16:18.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14952025-01-25T00:16:18.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14962025-01-25T00:16:18.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14972025-01-25T00:16:18.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14982025-01-25T00:16:18.867ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4c7a614c-075f-4152-a9c4-104e924a872c", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14992025-01-25T00:16:18.867ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15002025-01-25T00:16:18.873ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
15012025-01-25T00:16:18.873ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 458.882629ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
15022025-01-25T00:16:18.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15032025-01-25T00:16:18.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15042025-01-25T00:16:18.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15052025-01-25T00:16:18.883ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 1 version = 2
15062025-01-25T00:16:18.884ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
15072025-01-25T00:16:18.884ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-25 00:10:47.835608 UTC dns_group = external generation = 2
15082025-01-25T00:16:18.884ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 469.427254ms iteration = 7 status = {"generation":2}
15092025-01-25T00:16:18.886ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
15102025-01-25T00:16:18.886ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
15112025-01-25T00:16:18.886ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-25 00:10:46.879674 UTC dns_group = internal generation = 1
15122025-01-25T00:16:18.886ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 471.822307ms iteration = 7 status = {"generation":1}
15132025-01-25T00:16:18.896ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 481.699518ms iteration = 15 status = {"physical_disks_added":0}
15142025-01-25T00:16:18.908ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15152025-01-25T00:16:18.909ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5740bdb7-d922-4851-a267-057c598fb3e4", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15162025-01-25T00:16:18.909ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15172025-01-25T00:16:18.911ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-25T00:10:16.530962Z, time_modified: 2025-01-25T00:10:16.530962Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }) }
15182025-01-25T00:16:18.911ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 497.003138ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]}},"default_endpoint":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
15192025-01-25T00:16:18.911ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0bd7df0d-ee01-4a3b-ad7a-16fe2a863b82", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15202025-01-25T00:16:18.911ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15212025-01-25T00:16:18.913ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e8cfcc1c-6ad6-4fe3-97ce-2e15d794d8ed", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15222025-01-25T00:16:18.913ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15232025-01-25T00:16:18.916ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15242025-01-25T00:16:18.916ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 502.271645ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
15252025-01-25T00:16:18.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15262025-01-25T00:16:18.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15272025-01-25T00:16:18.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15282025-01-25T00:16:18.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15292025-01-25T00:16:18.957ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
15302025-01-25T00:16:18.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15312025-01-25T00:16:18.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15322025-01-25T00:16:18.969ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15332025-01-25T00:16:18.970ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "55ef5ccb-79cf-4c8b-8091-9b9cc0cd4c21", "content-length": "134", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} })
15342025-01-25T00:16:18.970ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
15352025-01-25T00:16:18.970ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
15362025-01-25T00:16:18.970ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15372025-01-25T00:16:18.970ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15382025-01-25T00:16:18.970ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15392025-01-25T00:16:18.970ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15402025-01-25T00:16:18.970ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15412025-01-25T00:16:18.970ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15422025-01-25T00:16:18.970ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15432025-01-25T00:16:18.970ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15442025-01-25T00:16:18.970ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
15452025-01-25T00:16:18.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15462025-01-25T00:16:18.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15472025-01-25T00:16:18.973ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15482025-01-25T00:16:18.973ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "53194ca3-c589-4d17-a853-74546c6ec0e4", "content-length": "2", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} })
15492025-01-25T00:16:18.973ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15502025-01-25T00:16:18.973ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e2b1db8-499c-46c6-97a2-26399b5be1fb", "content-length": "52", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} })
15512025-01-25T00:16:18.973ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
15522025-01-25T00:16:18.973ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15532025-01-25T00:16:18.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15542025-01-25T00:16:18.989ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15552025-01-25T00:16:18.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15562025-01-25T00:16:18.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15572025-01-25T00:16:18.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15582025-01-25T00:16:18.992ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15592025-01-25T00:16:18.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15602025-01-25T00:16:18.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15612025-01-25T00:16:19.088ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ca6706fe-eae1-4888-b02d-54b5b0930606", "date": "Sat, 25 Jan 2025 00:16:18 GMT"} })
15622025-01-25T00:16:19.088ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
15632025-01-25T00:16:19.088ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15642025-01-25T00:16:19.088ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15652025-01-25T00:16:19.144ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
15662025-01-25T00:16:19.144ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
15672025-01-25T00:16:19.178ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
15682025-01-25T00:16:19.178ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:46059
15692025-01-25T00:16:19.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46059 req_id = c637dbd1-12ce-4e31-b39e-bc1d6100d6cd roles = RoleSet { roles: {} } uri = /metrics/producers
15702025-01-25T00:16:19.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46059 req_id = c637dbd1-12ce-4e31-b39e-bc1d6100d6cd resource = Database result = Ok(()) uri = /metrics/producers
15712025-01-25T00:16:19.188ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "010530e0-4cd3-41c7-a875-cc7e3dce6297", "content-length": "682", "date": "Sat, 25 Jan 2025 00:16:19 GMT"} })
15722025-01-25T00:16:19.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15732025-01-25T00:16:19.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15742025-01-25T00:16:19.189ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "be2fa22b-227c-4be2-bedc-438893628fa9", "content-length": "691", "date": "Sat, 25 Jan 2025 00:16:19 GMT"} })
15752025-01-25T00:16:19.189ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
15762025-01-25T00:16:19.189ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
15772025-01-25T00:16:19.189ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
15782025-01-25T00:16:19.190ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 776.524083ms iteration = 13 status = {}
15792025-01-25T00:16:19.193ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15802025-01-25T00:16:19.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15812025-01-25T00:16:19.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15822025-01-25T00:16:19.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15832025-01-25T00:16:19.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15842025-01-25T00:16:19.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15852025-01-25T00:16:19.205ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 791.1825ms iteration = 13 status = {}
15862025-01-25T00:16:19.216ZINFOnexus: assigned collector to new producer collector_id = 512ae8cc-0c00-4148-bad7-ae5dd7be4169 file = nexus/src/app/oximeter.rs:76 producer_id = af353237-4651-4023-8604-ee309f64048e
15872025-01-25T00:16:19.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38136 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46059 req_id = c637dbd1-12ce-4e31-b39e-bc1d6100d6cd response_code = 201 uri = /metrics/producers
15882025-01-25T00:16:19.216ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "c637dbd1-12ce-4e31-b39e-bc1d6100d6cd", "content-length": "41", "date": "Sat, 25 Jan 2025 00:16:19 GMT"} })
15892025-01-25T00:16:19.218ZDEBGnexus (producer-registration-task): registered with nexus successfully
15902025-01-25T00:16:19.218ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
15912025-01-25T00:16:19.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = baa3d7c0-210e-4de1-975c-41904396a011 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
15922025-01-25T00:16:19.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = baa3d7c0-210e-4de1-975c-41904396a011 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
15932025-01-25T00:16:19.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = baa3d7c0-210e-4de1-975c-41904396a011 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
15942025-01-25T00:16:19.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6c0b7ae6-0ec4-4302-90ce-47ea74f11777 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
15952025-01-25T00:16:19.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6c0b7ae6-0ec4-4302-90ce-47ea74f11777 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
15962025-01-25T00:16:19.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6c0b7ae6-0ec4-4302-90ce-47ea74f11777 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
15972025-01-25T00:16:20.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dce076cb-76f0-41ae-a17f-bcecf3b18e4f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
15982025-01-25T00:16:20.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dce076cb-76f0-41ae-a17f-bcecf3b18e4f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
15992025-01-25T00:16:20.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dce076cb-76f0-41ae-a17f-bcecf3b18e4f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16002025-01-25T00:16:20.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 497 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 902dbb6d-9bad-4b49-9ede-72e4ae0665ef response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
16012025-01-25T00:16:21.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0ca3741-3be1-4cde-bbb5-60b115bb40c8 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16022025-01-25T00:16:21.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0ca3741-3be1-4cde-bbb5-60b115bb40c8 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16032025-01-25T00:16:21.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0ca3741-3be1-4cde-bbb5-60b115bb40c8 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16042025-01-25T00:16:22.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0b36ec6-3f04-4a47-a6c7-971e549904df roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16052025-01-25T00:16:22.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0b36ec6-3f04-4a47-a6c7-971e549904df resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16062025-01-25T00:16:22.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0b36ec6-3f04-4a47-a6c7-971e549904df response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16072025-01-25T00:16:23.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1d9ebb4a-d3c7-4790-8851-7a0c8406564e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16082025-01-25T00:16:23.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1d9ebb4a-d3c7-4790-8851-7a0c8406564e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16092025-01-25T00:16:23.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1d9ebb4a-d3c7-4790-8851-7a0c8406564e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16102025-01-25T00:16:24.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4f3290d1-f0f7-4756-bd2c-fdc54ed5c66f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16112025-01-25T00:16:24.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4f3290d1-f0f7-4756-bd2c-fdc54ed5c66f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16122025-01-25T00:16:24.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4f3290d1-f0f7-4756-bd2c-fdc54ed5c66f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16132025-01-25T00:16:25.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fe269432-cf58-4489-9c07-9e72b0c2a767 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16142025-01-25T00:16:25.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fe269432-cf58-4489-9c07-9e72b0c2a767 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16152025-01-25T00:16:25.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fe269432-cf58-4489-9c07-9e72b0c2a767 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16162025-01-25T00:16:26.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2861094a-324f-49bf-a7cf-27d889d031ed roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16172025-01-25T00:16:26.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2861094a-324f-49bf-a7cf-27d889d031ed resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16182025-01-25T00:16:26.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2861094a-324f-49bf-a7cf-27d889d031ed response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16192025-01-25T00:16:27.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a3d5abde-6df0-4be0-bdd0-b6ba6121c597 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16202025-01-25T00:16:27.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a3d5abde-6df0-4be0-bdd0-b6ba6121c597 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16212025-01-25T00:16:27.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a3d5abde-6df0-4be0-bdd0-b6ba6121c597 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16222025-01-25T00:16:28.414ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
16232025-01-25T00:16:28.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16242025-01-25T00:16:28.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16252025-01-25T00:16:28.415ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
16262025-01-25T00:16:28.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16272025-01-25T00:16:28.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16282025-01-25T00:16:28.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16292025-01-25T00:16:28.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16302025-01-25T00:16:28.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16312025-01-25T00:16:28.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16322025-01-25T00:16:28.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16332025-01-25T00:16:28.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16342025-01-25T00:16:28.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16352025-01-25T00:16:28.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
16362025-01-25T00:16:28.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16372025-01-25T00:16:28.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16382025-01-25T00:16:28.436ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
16392025-01-25T00:16:28.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.401766ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
16402025-01-25T00:16:28.447ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16412025-01-25T00:16:28.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16422025-01-25T00:16:28.475ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.492205ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16432025-01-25T00:16:28.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bd917c1f-0430-4aea-857f-8b00264ab16a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16442025-01-25T00:16:28.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bd917c1f-0430-4aea-857f-8b00264ab16a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16452025-01-25T00:16:28.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bd917c1f-0430-4aea-857f-8b00264ab16a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16462025-01-25T00:16:29.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 49d0f492-3f6f-4d35-8828-e55134625756 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16472025-01-25T00:16:29.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 49d0f492-3f6f-4d35-8828-e55134625756 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16482025-01-25T00:16:29.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 49d0f492-3f6f-4d35-8828-e55134625756 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16492025-01-25T00:16:30.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 557 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = bcea56bb-7497-4cb6-9f19-7583e517f94a response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
16502025-01-25T00:16:31.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 565f5a7e-820f-4c88-a266-ac04add95794 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16512025-01-25T00:16:31.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 565f5a7e-820f-4c88-a266-ac04add95794 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16522025-01-25T00:16:31.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 565f5a7e-820f-4c88-a266-ac04add95794 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16532025-01-25T00:16:32.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 322a9bce-9daf-420c-81f3-e8238bb39525 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16542025-01-25T00:16:32.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 322a9bce-9daf-420c-81f3-e8238bb39525 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16552025-01-25T00:16:32.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 322a9bce-9daf-420c-81f3-e8238bb39525 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16562025-01-25T00:16:33.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 00493ad9-531b-42e4-bda0-82355c493a39 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16572025-01-25T00:16:33.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 00493ad9-531b-42e4-bda0-82355c493a39 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16582025-01-25T00:16:33.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 00493ad9-531b-42e4-bda0-82355c493a39 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16592025-01-25T00:16:34.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 947d99b2-75d5-4d1f-8c29-6ce36d62e308 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16602025-01-25T00:16:34.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 947d99b2-75d5-4d1f-8c29-6ce36d62e308 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16612025-01-25T00:16:34.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 947d99b2-75d5-4d1f-8c29-6ce36d62e308 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16622025-01-25T00:16:35.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1cf4c1fe-fe81-42b6-9e02-bd4cabedab0b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16632025-01-25T00:16:35.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1cf4c1fe-fe81-42b6-9e02-bd4cabedab0b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16642025-01-25T00:16:35.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1cf4c1fe-fe81-42b6-9e02-bd4cabedab0b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16652025-01-25T00:16:36.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4db8cb75-fafc-4ee9-8de8-72fc96c466bb roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16662025-01-25T00:16:36.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4db8cb75-fafc-4ee9-8de8-72fc96c466bb resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16672025-01-25T00:16:36.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4db8cb75-fafc-4ee9-8de8-72fc96c466bb response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16682025-01-25T00:16:37.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e744eec1-2e0d-4029-a566-788a16645519 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16692025-01-25T00:16:37.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e744eec1-2e0d-4029-a566-788a16645519 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16702025-01-25T00:16:37.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e744eec1-2e0d-4029-a566-788a16645519 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16712025-01-25T00:16:38.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9726b319-5bb4-4ae8-8d99-ffb1cfbb4fb4 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16722025-01-25T00:16:38.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9726b319-5bb4-4ae8-8d99-ffb1cfbb4fb4 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16732025-01-25T00:16:38.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2853 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9726b319-5bb4-4ae8-8d99-ffb1cfbb4fb4 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16742025-01-25T00:16:38.414ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
16752025-01-25T00:16:38.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16762025-01-25T00:16:38.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16772025-01-25T00:16:38.415ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
16782025-01-25T00:16:38.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16792025-01-25T00:16:38.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16802025-01-25T00:16:38.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16812025-01-25T00:16:38.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16822025-01-25T00:16:38.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16832025-01-25T00:16:38.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16842025-01-25T00:16:38.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16852025-01-25T00:16:38.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16862025-01-25T00:16:38.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16872025-01-25T00:16:38.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
16882025-01-25T00:16:38.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16892025-01-25T00:16:38.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16902025-01-25T00:16:38.437ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
16912025-01-25T00:16:38.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.935409ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
16922025-01-25T00:16:38.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16932025-01-25T00:16:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16942025-01-25T00:16:38.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.624925ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16952025-01-25T00:16:39.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b73f15f9-9152-4942-ad6f-b187bd1794c1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16962025-01-25T00:16:39.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b73f15f9-9152-4942-ad6f-b187bd1794c1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16972025-01-25T00:16:39.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1855 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b73f15f9-9152-4942-ad6f-b187bd1794c1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16982025-01-25T00:16:40.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69154c7c-befa-44e7-9bbf-e805c393b5dc roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
16992025-01-25T00:16:40.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69154c7c-befa-44e7-9bbf-e805c393b5dc resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17002025-01-25T00:16:40.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69154c7c-befa-44e7-9bbf-e805c393b5dc response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17012025-01-25T00:16:40.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 546 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 0704ee60-cfb6-4af2-b71e-2776f987b937 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
17022025-01-25T00:16:41.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2ea37b10-0b05-415d-b499-08bc1d6c0984 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17032025-01-25T00:16:41.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2ea37b10-0b05-415d-b499-08bc1d6c0984 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17042025-01-25T00:16:41.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2ea37b10-0b05-415d-b499-08bc1d6c0984 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17052025-01-25T00:16:42.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 78765297-58b2-46f2-afd3-c09d509f64b2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17062025-01-25T00:16:42.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 78765297-58b2-46f2-afd3-c09d509f64b2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17072025-01-25T00:16:42.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 78765297-58b2-46f2-afd3-c09d509f64b2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17082025-01-25T00:16:43.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 62f08c90-9ef9-4a0e-b940-26a6fd5d8490 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17092025-01-25T00:16:43.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 62f08c90-9ef9-4a0e-b940-26a6fd5d8490 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17102025-01-25T00:16:43.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 62f08c90-9ef9-4a0e-b940-26a6fd5d8490 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17112025-01-25T00:16:44.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 27e87f32-fde9-4f32-876b-5f75b1953bbf roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17122025-01-25T00:16:44.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 27e87f32-fde9-4f32-876b-5f75b1953bbf resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17132025-01-25T00:16:44.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1817 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 27e87f32-fde9-4f32-876b-5f75b1953bbf response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17142025-01-25T00:16:45.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a50783c1-f4d2-4805-8adb-261c82a27d45 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17152025-01-25T00:16:45.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a50783c1-f4d2-4805-8adb-261c82a27d45 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17162025-01-25T00:16:45.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a50783c1-f4d2-4805-8adb-261c82a27d45 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17172025-01-25T00:16:45.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 10133f08-e333-495e-8cb1-41597f5d6ee6 roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
17182025-01-25T00:16:45.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 10133f08-e333-495e-8cb1-41597f5d6ee6 resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
17192025-01-25T00:16:45.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 10133f08-e333-495e-8cb1-41597f5d6ee6 response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
17202025-01-25T00:16:45.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 80b0a05c-1cca-4467-a1b4-4a5409836d90 roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
17212025-01-25T00:16:45.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 80b0a05c-1cca-4467-a1b4-4a5409836d90 resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
17222025-01-25T00:16:45.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 80b0a05c-1cca-4467-a1b4-4a5409836d90 response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
17232025-01-25T00:16:46.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ec42342c-780c-4729-8c3c-4483fb551429 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17242025-01-25T00:16:46.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ec42342c-780c-4729-8c3c-4483fb551429 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17252025-01-25T00:16:46.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ec42342c-780c-4729-8c3c-4483fb551429 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17262025-01-25T00:16:47.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = af049f62-666b-46f9-86c9-d48eb015777d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17272025-01-25T00:16:47.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = af049f62-666b-46f9-86c9-d48eb015777d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17282025-01-25T00:16:47.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = af049f62-666b-46f9-86c9-d48eb015777d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17292025-01-25T00:16:48.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c0ceec0-555e-42ce-915e-29c6d2d5b109 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17302025-01-25T00:16:48.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c0ceec0-555e-42ce-915e-29c6d2d5b109 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17312025-01-25T00:16:48.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c0ceec0-555e-42ce-915e-29c6d2d5b109 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
17322025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
17332025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
17342025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
17352025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17362025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17372025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17382025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
17392025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17402025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
17412025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17422025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
17432025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17442025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
17452025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
17462025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17472025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
17482025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
17492025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17502025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17512025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
17522025-01-25T00:16:48.415ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17532025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17542025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
17552025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17562025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
17572025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17582025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
17592025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17602025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
17612025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17622025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
17632025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17642025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17652025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
17662025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17672025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
17682025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17692025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17702025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17712025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17722025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17732025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17742025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17752025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17762025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17772025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17782025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17792025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17802025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17812025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17822025-01-25T00:16:48.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17832025-01-25T00:16:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17842025-01-25T00:16:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17852025-01-25T00:16:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17862025-01-25T00:16:48.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17872025-01-25T00:16:48.418ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1331, tv_nsec: 143454442 } })
17882025-01-25T00:16:48.418ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
17892025-01-25T00:16:48.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17902025-01-25T00:16:48.419ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1331, tv_nsec: 144567938 } })
17912025-01-25T00:16:48.419ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.405783ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17922025-01-25T00:16:48.419ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
17932025-01-25T00:16:48.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17942025-01-25T00:16:48.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17952025-01-25T00:16:48.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17962025-01-25T00:16:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17972025-01-25T00:16:48.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17982025-01-25T00:16:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17992025-01-25T00:16:48.431ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18002025-01-25T00:16:48.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18012025-01-25T00:16:48.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18022025-01-25T00:16:48.433ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18032025-01-25T00:16:48.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18042025-01-25T00:16:48.434ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18052025-01-25T00:16:48.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18062025-01-25T00:16:48.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18072025-01-25T00:16:48.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18082025-01-25T00:16:48.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18092025-01-25T00:16:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18102025-01-25T00:16:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18112025-01-25T00:16:48.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18122025-01-25T00:16:48.443ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1331, tv_nsec: 168716544 } })
18132025-01-25T00:16:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18142025-01-25T00:16:48.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
18152025-01-25T00:16:48.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18162025-01-25T00:16:48.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18172025-01-25T00:16:48.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18182025-01-25T00:16:48.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18192025-01-25T00:16:48.450ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18202025-01-25T00:16:48.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18212025-01-25T00:16:48.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18222025-01-25T00:16:48.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18232025-01-25T00:16:48.478ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18242025-01-25T00:16:48.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18252025-01-25T00:16:48.481ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.780973ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18262025-01-25T00:16:48.486ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18272025-01-25T00:16:48.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18282025-01-25T00:16:48.489ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18292025-01-25T00:16:48.489ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18302025-01-25T00:16:48.489ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18312025-01-25T00:16:48.489ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18322025-01-25T00:16:48.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18332025-01-25T00:16:48.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18342025-01-25T00:16:48.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18352025-01-25T00:16:48.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18362025-01-25T00:16:48.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18372025-01-25T00:16:48.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18382025-01-25T00:16:48.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18392025-01-25T00:16:48.495ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18402025-01-25T00:16:48.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.370454ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18412025-01-25T00:16:48.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
18422025-01-25T00:16:48.499ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18432025-01-25T00:16:48.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18442025-01-25T00:16:48.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18452025-01-25T00:16:48.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18462025-01-25T00:16:48.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18472025-01-25T00:16:48.501ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18482025-01-25T00:16:48.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18492025-01-25T00:16:48.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 86.31113ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
18502025-01-25T00:16:48.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 86.311919ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
18512025-01-25T00:16:48.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18522025-01-25T00:16:48.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18532025-01-25T00:16:48.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18542025-01-25T00:16:48.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18552025-01-25T00:16:48.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18562025-01-25T00:16:48.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
18572025-01-25T00:16:48.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18582025-01-25T00:16:48.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18592025-01-25T00:16:48.512ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18602025-01-25T00:16:48.514ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18612025-01-25T00:16:48.514ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18622025-01-25T00:16:48.514ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18632025-01-25T00:16:48.514ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 99.384508ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18642025-01-25T00:16:48.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18652025-01-25T00:16:48.516ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
18662025-01-25T00:16:48.516ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18672025-01-25T00:16:48.516ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50bd3671-22b4-499a-8fcc-54e751533d64", "content-length": "26", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
18682025-01-25T00:16:48.516ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18692025-01-25T00:16:48.519ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18702025-01-25T00:16:48.525ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
18712025-01-25T00:16:48.525ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18722025-01-25T00:16:48.526ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "737eb1d9-bdac-44da-88a4-fd3c8893f09b", "content-length": "26", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
18732025-01-25T00:16:48.526ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18742025-01-25T00:16:48.528ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18752025-01-25T00:16:48.528ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
18762025-01-25T00:16:48.528ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.676646ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
18772025-01-25T00:16:48.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18782025-01-25T00:16:48.541ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
18792025-01-25T00:16:48.541ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18802025-01-25T00:16:48.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18812025-01-25T00:16:48.542ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f84f2e4-9fed-49cd-a82a-cdaef866d786", "content-length": "26", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
18822025-01-25T00:16:48.542ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18832025-01-25T00:16:48.543ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
18842025-01-25T00:16:48.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18852025-01-25T00:16:48.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.930687ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18862025-01-25T00:16:48.547ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18872025-01-25T00:16:48.547ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18882025-01-25T00:16:48.547ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18892025-01-25T00:16:48.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18902025-01-25T00:16:48.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
18912025-01-25T00:16:48.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18922025-01-25T00:16:48.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18932025-01-25T00:16:48.550ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 135.592706ms iteration = 14 status = 0
18942025-01-25T00:16:48.553ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18952025-01-25T00:16:48.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
18962025-01-25T00:16:48.557ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18972025-01-25T00:16:48.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18982025-01-25T00:16:48.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18992025-01-25T00:16:48.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19002025-01-25T00:16:48.568ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19012025-01-25T00:16:48.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19022025-01-25T00:16:48.571ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19032025-01-25T00:16:48.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19042025-01-25T00:16:48.580ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19052025-01-25T00:16:48.580ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19062025-01-25T00:16:48.580ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 164.861879ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19072025-01-25T00:16:48.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 169.979035ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19082025-01-25T00:16:48.586ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 171.298012ms iteration = 14 status = {}
19092025-01-25T00:16:48.599ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
19102025-01-25T00:16:48.600ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 184.584031ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
19112025-01-25T00:16:48.601ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19122025-01-25T00:16:48.601ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e193d16d-b6c2-4843-ae10-e9781a798254", "content-length": "1", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
19132025-01-25T00:16:48.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19142025-01-25T00:16:48.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19152025-01-25T00:16:48.606ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 191.084845ms iteration = 14 status = null
19162025-01-25T00:16:48.606ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.451547ms iteration = 16 status = {"physical_disks_added":0}
19172025-01-25T00:16:48.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182025-01-25T00:16:48.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19192025-01-25T00:16:48.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19202025-01-25T00:16:48.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19212025-01-25T00:16:48.678ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19222025-01-25T00:16:48.678ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19232025-01-25T00:16:48.679ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b213e600-c93e-439e-8f08-cd2ae965e34f", "content-length": "372", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
19242025-01-25T00:16:48.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19252025-01-25T00:16:48.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19262025-01-25T00:16:48.685ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19272025-01-25T00:16:48.685ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a8d4bc4-f9e7-4005-9360-aff7cf4b6c11", "content-length": "691", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
19282025-01-25T00:16:48.685ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
19292025-01-25T00:16:48.685ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
19302025-01-25T00:16:48.685ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
19312025-01-25T00:16:48.687ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 272.008157ms iteration = 14 status = {}
19322025-01-25T00:16:48.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19332025-01-25T00:16:48.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19342025-01-25T00:16:48.714ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
19352025-01-25T00:16:48.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19362025-01-25T00:16:48.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19372025-01-25T00:16:48.721ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
19382025-01-25T00:16:48.721ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19392025-01-25T00:16:48.721ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fbffe21f-deaf-446a-8245-30e8cbd7a034", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
19402025-01-25T00:16:48.721ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19412025-01-25T00:16:48.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19422025-01-25T00:16:48.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19432025-01-25T00:16:48.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19442025-01-25T00:16:48.724ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
19452025-01-25T00:16:48.724ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "84b91f38-2976-4f1b-a623-7524669780b4", "content-length": "134", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
19462025-01-25T00:16:48.724ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
19472025-01-25T00:16:48.724ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
19482025-01-25T00:16:48.725ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
19492025-01-25T00:16:48.725ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19502025-01-25T00:16:48.725ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19512025-01-25T00:16:48.725ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19522025-01-25T00:16:48.725ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19532025-01-25T00:16:48.725ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
19542025-01-25T00:16:48.725ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
19552025-01-25T00:16:48.725ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
19562025-01-25T00:16:48.725ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
19572025-01-25T00:16:48.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19582025-01-25T00:16:48.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19592025-01-25T00:16:48.726ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19602025-01-25T00:16:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19612025-01-25T00:16:48.727ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
19622025-01-25T00:16:48.727ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "67a221d9-4a61-499d-9f50-18a5744ec181", "content-length": "2", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
19632025-01-25T00:16:48.727ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
19642025-01-25T00:16:48.727ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "82d48644-15b9-4536-8f97-95bd80bd83a4", "content-length": "52", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
19652025-01-25T00:16:48.727ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
19662025-01-25T00:16:48.727ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
19672025-01-25T00:16:48.730ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19682025-01-25T00:16:48.730ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19692025-01-25T00:16:48.830ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d4673868-39bf-46ce-9617-a354d9eecb1a", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
19702025-01-25T00:16:48.830ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
19712025-01-25T00:16:48.830ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
19722025-01-25T00:16:48.831ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "32e25d2b-fe3e-4327-9299-e83a9c0fe626", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
19732025-01-25T00:16:48.833ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 417.769435ms iteration = 14 status = {}
19742025-01-25T00:16:48.833ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a472d29-d7e8-4596-b64f-c78f725ef192", "content-length": "682", "date": "Sat, 25 Jan 2025 00:16:48 GMT"} })
19752025-01-25T00:16:48.833ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19762025-01-25T00:16:48.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19772025-01-25T00:16:48.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19782025-01-25T00:16:48.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19792025-01-25T00:16:48.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19802025-01-25T00:16:48.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19812025-01-25T00:16:48.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19822025-01-25T00:16:48.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19832025-01-25T00:16:48.857ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 442.385793ms iteration = 14 status = {}
19842025-01-25T00:16:49.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 79b4112f-e783-4d63-ade5-0b5fd7233abe roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
19852025-01-25T00:16:49.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 79b4112f-e783-4d63-ade5-0b5fd7233abe resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
19862025-01-25T00:16:49.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 79b4112f-e783-4d63-ade5-0b5fd7233abe response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
19872025-01-25T00:16:49.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 666d6bdb-3f77-49c0-9d76-a5f66de66a09 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
19882025-01-25T00:16:49.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 666d6bdb-3f77-49c0-9d76-a5f66de66a09 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
19892025-01-25T00:16:49.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 666d6bdb-3f77-49c0-9d76-a5f66de66a09 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
19902025-01-25T00:16:50.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 73b7e79f-cf23-434f-8df8-d484e6b65404 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
19912025-01-25T00:16:50.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 73b7e79f-cf23-434f-8df8-d484e6b65404 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
19922025-01-25T00:16:50.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 73b7e79f-cf23-434f-8df8-d484e6b65404 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
19932025-01-25T00:16:50.978ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 526 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = ec1c373b-1efc-4d6d-9923-1dafb59ef28c response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
19942025-01-25T00:16:51.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2b835d73-a2ac-4115-ba1f-8201b078cfdb roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
19952025-01-25T00:16:51.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2b835d73-a2ac-4115-ba1f-8201b078cfdb resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
19962025-01-25T00:16:51.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2b835d73-a2ac-4115-ba1f-8201b078cfdb response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
19972025-01-25T00:16:52.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1f76c24b-2f07-4f2f-bc31-0d295ab7bc5c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
19982025-01-25T00:16:52.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1f76c24b-2f07-4f2f-bc31-0d295ab7bc5c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
19992025-01-25T00:16:52.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1f76c24b-2f07-4f2f-bc31-0d295ab7bc5c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20002025-01-25T00:16:53.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2f853fd7-b064-4b82-acc5-8acbb0dc6f3c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20012025-01-25T00:16:53.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2f853fd7-b064-4b82-acc5-8acbb0dc6f3c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20022025-01-25T00:16:53.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2f853fd7-b064-4b82-acc5-8acbb0dc6f3c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20032025-01-25T00:16:54.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8d116a8e-6cae-4d25-9671-81c4b3036095 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20042025-01-25T00:16:54.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8d116a8e-6cae-4d25-9671-81c4b3036095 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20052025-01-25T00:16:54.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8d116a8e-6cae-4d25-9671-81c4b3036095 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20062025-01-25T00:16:55.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ff30f0cc-5445-4f2b-a63c-9e4fdc288785 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20072025-01-25T00:16:55.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ff30f0cc-5445-4f2b-a63c-9e4fdc288785 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20082025-01-25T00:16:55.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1901 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ff30f0cc-5445-4f2b-a63c-9e4fdc288785 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20092025-01-25T00:16:56.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dbf5f8dd-07bf-4095-b79f-c375e51e2009 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20102025-01-25T00:16:56.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dbf5f8dd-07bf-4095-b79f-c375e51e2009 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20112025-01-25T00:16:56.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dbf5f8dd-07bf-4095-b79f-c375e51e2009 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20122025-01-25T00:16:57.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e55ce90d-c07c-467c-a077-7e8cae2f5e16 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20132025-01-25T00:16:57.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e55ce90d-c07c-467c-a077-7e8cae2f5e16 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20142025-01-25T00:16:57.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e55ce90d-c07c-467c-a077-7e8cae2f5e16 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20152025-01-25T00:16:58.415ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
20162025-01-25T00:16:58.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20172025-01-25T00:16:58.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20182025-01-25T00:16:58.415ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
20192025-01-25T00:16:58.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20202025-01-25T00:16:58.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20212025-01-25T00:16:58.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20222025-01-25T00:16:58.418ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20232025-01-25T00:16:58.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20242025-01-25T00:16:58.419ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.628969ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20252025-01-25T00:16:58.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20262025-01-25T00:16:58.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20272025-01-25T00:16:58.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20282025-01-25T00:16:58.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20292025-01-25T00:16:58.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20302025-01-25T00:16:58.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20312025-01-25T00:16:58.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
20322025-01-25T00:16:58.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20332025-01-25T00:16:58.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20342025-01-25T00:16:58.435ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
20352025-01-25T00:16:58.435ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.122205ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
20362025-01-25T00:16:58.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 93f80cfa-498f-4268-a5cc-84ff791835fd roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20372025-01-25T00:16:58.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 93f80cfa-498f-4268-a5cc-84ff791835fd resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20382025-01-25T00:16:58.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 93f80cfa-498f-4268-a5cc-84ff791835fd response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20392025-01-25T00:16:59.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6a83317e-9b8d-4e0b-8238-7137ee87879d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20402025-01-25T00:16:59.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6a83317e-9b8d-4e0b-8238-7137ee87879d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20412025-01-25T00:16:59.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6a83317e-9b8d-4e0b-8238-7137ee87879d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20422025-01-25T00:17:00.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 286a408c-b131-45a1-95e3-c542dccc78c9 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20432025-01-25T00:17:00.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 286a408c-b131-45a1-95e3-c542dccc78c9 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20442025-01-25T00:17:00.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 286a408c-b131-45a1-95e3-c542dccc78c9 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20452025-01-25T00:17:00.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 493 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 81bb7e73-1a36-4bd0-9297-02fecd49df7f response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
20462025-01-25T00:17:01.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd429a00-7650-46d4-8132-a5c4694241dc roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20472025-01-25T00:17:01.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd429a00-7650-46d4-8132-a5c4694241dc resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20482025-01-25T00:17:01.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd429a00-7650-46d4-8132-a5c4694241dc response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20492025-01-25T00:17:02.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = eff36d53-511d-434c-804e-6d6778acf571 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20502025-01-25T00:17:02.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = eff36d53-511d-434c-804e-6d6778acf571 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20512025-01-25T00:17:02.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = eff36d53-511d-434c-804e-6d6778acf571 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20522025-01-25T00:17:03.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bb8adf33-e4d6-46be-9486-6e12aedaab60 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20532025-01-25T00:17:03.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bb8adf33-e4d6-46be-9486-6e12aedaab60 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20542025-01-25T00:17:03.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bb8adf33-e4d6-46be-9486-6e12aedaab60 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20552025-01-25T00:17:04.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1f87c49f-7fd8-476f-88cd-4b5694bd4225 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20562025-01-25T00:17:04.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1f87c49f-7fd8-476f-88cd-4b5694bd4225 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20572025-01-25T00:17:04.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1f87c49f-7fd8-476f-88cd-4b5694bd4225 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20582025-01-25T00:17:05.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd3c17b8-adb9-46ba-b868-a1aa0725dd33 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20592025-01-25T00:17:05.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd3c17b8-adb9-46ba-b868-a1aa0725dd33 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20602025-01-25T00:17:05.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd3c17b8-adb9-46ba-b868-a1aa0725dd33 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20612025-01-25T00:17:06.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b16a510f-3a05-4fc5-90df-e639362d99c1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20622025-01-25T00:17:06.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b16a510f-3a05-4fc5-90df-e639362d99c1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20632025-01-25T00:17:06.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b16a510f-3a05-4fc5-90df-e639362d99c1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20642025-01-25T00:17:07.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2dc23705-51c4-4c29-a67e-2b27d21edbb0 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20652025-01-25T00:17:07.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2dc23705-51c4-4c29-a67e-2b27d21edbb0 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20662025-01-25T00:17:07.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2dc23705-51c4-4c29-a67e-2b27d21edbb0 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20672025-01-25T00:17:08.415ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
20682025-01-25T00:17:08.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20692025-01-25T00:17:08.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20702025-01-25T00:17:08.415ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
20712025-01-25T00:17:08.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20722025-01-25T00:17:08.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20732025-01-25T00:17:08.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20742025-01-25T00:17:08.417ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20752025-01-25T00:17:08.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20762025-01-25T00:17:08.419ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.067196ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20772025-01-25T00:17:08.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20782025-01-25T00:17:08.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20792025-01-25T00:17:08.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20802025-01-25T00:17:08.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20812025-01-25T00:17:08.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20822025-01-25T00:17:08.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20832025-01-25T00:17:08.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
20842025-01-25T00:17:08.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20852025-01-25T00:17:08.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20862025-01-25T00:17:08.436ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
20872025-01-25T00:17:08.436ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.886189ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
20882025-01-25T00:17:08.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b157041b-92e6-4e18-98b9-f215373232bb roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20892025-01-25T00:17:08.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b157041b-92e6-4e18-98b9-f215373232bb resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20902025-01-25T00:17:08.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b157041b-92e6-4e18-98b9-f215373232bb response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20912025-01-25T00:17:09.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e63912f1-f505-4d38-bf9f-8a5d37049e68 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20922025-01-25T00:17:09.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e63912f1-f505-4d38-bf9f-8a5d37049e68 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20932025-01-25T00:17:09.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e63912f1-f505-4d38-bf9f-8a5d37049e68 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20942025-01-25T00:17:10.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3b7f3e37-d1d3-4412-a250-53d22280f3f3 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20952025-01-25T00:17:10.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3b7f3e37-d1d3-4412-a250-53d22280f3f3 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20962025-01-25T00:17:10.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3b7f3e37-d1d3-4412-a250-53d22280f3f3 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20972025-01-25T00:17:10.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 529 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 1f670295-4116-47dc-9af4-c2da5345a71e response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
20982025-01-25T00:17:11.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0617e7bb-d804-48af-9bff-7c767337496b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
20992025-01-25T00:17:11.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0617e7bb-d804-48af-9bff-7c767337496b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21002025-01-25T00:17:11.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0617e7bb-d804-48af-9bff-7c767337496b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21012025-01-25T00:17:12.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ec134d19-4750-45e7-9985-9c1ed61e5f80 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21022025-01-25T00:17:12.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ec134d19-4750-45e7-9985-9c1ed61e5f80 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21032025-01-25T00:17:12.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ec134d19-4750-45e7-9985-9c1ed61e5f80 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21042025-01-25T00:17:13.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c09d6ab0-20aa-4197-b665-bc90356f7df9 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21052025-01-25T00:17:13.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c09d6ab0-20aa-4197-b665-bc90356f7df9 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21062025-01-25T00:17:13.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c09d6ab0-20aa-4197-b665-bc90356f7df9 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21072025-01-25T00:17:14.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 94c3662d-bbd4-477c-bbfe-1d8b714d602c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21082025-01-25T00:17:14.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 94c3662d-bbd4-477c-bbfe-1d8b714d602c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21092025-01-25T00:17:14.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 94c3662d-bbd4-477c-bbfe-1d8b714d602c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21102025-01-25T00:17:15.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 0e768040-84fb-4eda-b22c-3d3fcc654d54 roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
21112025-01-25T00:17:15.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 0e768040-84fb-4eda-b22c-3d3fcc654d54 resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
21122025-01-25T00:17:15.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 0e768040-84fb-4eda-b22c-3d3fcc654d54 response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
21132025-01-25T00:17:15.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = f82f8087-37b4-4628-87d9-3db3f6d8f1b2 roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
21142025-01-25T00:17:15.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = f82f8087-37b4-4628-87d9-3db3f6d8f1b2 resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
21152025-01-25T00:17:15.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 292ac065-56ac-483e-a3c2-c38006d44088 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21162025-01-25T00:17:15.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 292ac065-56ac-483e-a3c2-c38006d44088 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21172025-01-25T00:17:15.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = f82f8087-37b4-4628-87d9-3db3f6d8f1b2 response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
21182025-01-25T00:17:15.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 292ac065-56ac-483e-a3c2-c38006d44088 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21192025-01-25T00:17:16.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f469291b-20f8-4afe-824e-f721ecc05ced roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21202025-01-25T00:17:17.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f469291b-20f8-4afe-824e-f721ecc05ced resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21212025-01-25T00:17:17.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f469291b-20f8-4afe-824e-f721ecc05ced response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21222025-01-25T00:17:18.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 076fda51-58f4-4a80-b06f-98cd4fafd08f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21232025-01-25T00:17:18.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 076fda51-58f4-4a80-b06f-98cd4fafd08f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21242025-01-25T00:17:18.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 076fda51-58f4-4a80-b06f-98cd4fafd08f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
21252025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
21262025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
21272025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
21282025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21292025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
21302025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21312025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
21322025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21332025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
21342025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
21352025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21362025-01-25T00:17:18.415ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-25 00:07:18.415845210 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
21372025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
21382025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
21392025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21402025-01-25T00:17:18.415ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
21412025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
21422025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
21432025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21442025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
21452025-01-25T00:17:18.416ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2
21462025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
21472025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.06\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2"}
21482025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
21492025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21502025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
21512025-01-25T00:17:18.416ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
21522025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
21532025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
21542025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21552025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21562025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
21572025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21582025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
21592025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21602025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
21612025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
21622025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
21632025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21642025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21652025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
21662025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
21672025-01-25T00:17:18.416ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
21682025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
21692025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
21702025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21712025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21722025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
21732025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
21742025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21752025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
21762025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
21772025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
21782025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21792025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
21802025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21812025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
21822025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21832025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21842025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
21852025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
21862025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21872025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
21882025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
21892025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
21902025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21912025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21922025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21932025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
21942025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21952025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21962025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21972025-01-25T00:17:18.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21982025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21992025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22002025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22012025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22022025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22032025-01-25T00:17:18.417ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22685765-7656-499f-8835-1c19f38e16e6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1361, tv_nsec: 141431952 } })
22042025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22052025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22062025-01-25T00:17:18.417ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("167a4f68-f407-48e5-a9a6-22f96a22bf2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3a6aa3c-ea79-4881-9aa5-b12ba496f837.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1361, tv_nsec: 141485942 } })
22072025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22082025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22092025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
22102025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22112025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22122025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22132025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22142025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22152025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22162025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
22172025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.523448ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
22182025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
22192025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.571928ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
22202025-01-25T00:17:18.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22212025-01-25T00:17:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22222025-01-25T00:17:18.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22232025-01-25T00:17:18.419ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.81277ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22242025-01-25T00:17:18.420ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1361, tv_nsec: 144700769 } })
22252025-01-25T00:17:18.420ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
22262025-01-25T00:17:18.421ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-25 00:07:18.415845210 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
22272025-01-25T00:17:18.421ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.201187ms iteration = 8 status = {"expiration":"2025-01-25T00:07:18.415845210Z","pruned":[]}
22282025-01-25T00:17:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22292025-01-25T00:17:18.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22302025-01-25T00:17:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22312025-01-25T00:17:18.421ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1361, tv_nsec: 146237817 } })
22322025-01-25T00:17:18.422ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
22332025-01-25T00:17:18.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22342025-01-25T00:17:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22352025-01-25T00:17:18.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22362025-01-25T00:17:18.427ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22372025-01-25T00:17:18.427ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22382025-01-25T00:17:18.427ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22392025-01-25T00:17:18.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22402025-01-25T00:17:18.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22412025-01-25T00:17:18.428ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22422025-01-25T00:17:18.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22432025-01-25T00:17:18.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22442025-01-25T00:17:18.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22452025-01-25T00:17:18.430ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22462025-01-25T00:17:18.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
22472025-01-25T00:17:18.430ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22482025-01-25T00:17:18.430ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22492025-01-25T00:17:18.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22502025-01-25T00:17:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22512025-01-25T00:17:18.431ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22522025-01-25T00:17:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22532025-01-25T00:17:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22542025-01-25T00:17:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22552025-01-25T00:17:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22562025-01-25T00:17:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
22572025-01-25T00:17:18.431ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22582025-01-25T00:17:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22592025-01-25T00:17:18.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22602025-01-25T00:17:18.432ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22612025-01-25T00:17:18.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22622025-01-25T00:17:18.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22632025-01-25T00:17:18.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22642025-01-25T00:17:18.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22652025-01-25T00:17:18.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22662025-01-25T00:17:18.433ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.197779ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
22672025-01-25T00:17:18.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22682025-01-25T00:17:18.433ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.735073ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
22692025-01-25T00:17:18.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22702025-01-25T00:17:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22712025-01-25T00:17:18.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22722025-01-25T00:17:18.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22732025-01-25T00:17:18.439ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1361, tv_nsec: 164055380 } })
22742025-01-25T00:17:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22752025-01-25T00:17:18.440ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
22762025-01-25T00:17:18.440ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22772025-01-25T00:17:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22782025-01-25T00:17:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22792025-01-25T00:17:18.443ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
22802025-01-25T00:17:18.443ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
22812025-01-25T00:17:18.443ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
22822025-01-25T00:17:18.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22832025-01-25T00:17:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22842025-01-25T00:17:18.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22852025-01-25T00:17:18.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22862025-01-25T00:17:18.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22872025-01-25T00:17:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22882025-01-25T00:17:18.447ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22892025-01-25T00:17:18.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22902025-01-25T00:17:18.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22912025-01-25T00:17:18.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22922025-01-25T00:17:18.457ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22932025-01-25T00:17:18.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22942025-01-25T00:17:18.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22952025-01-25T00:17:18.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22962025-01-25T00:17:18.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22972025-01-25T00:17:18.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
22982025-01-25T00:17:18.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22992025-01-25T00:17:18.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23002025-01-25T00:17:18.486ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23012025-01-25T00:17:18.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23022025-01-25T00:17:18.493ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23032025-01-25T00:17:18.493ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23042025-01-25T00:17:18.493ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.92198ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23052025-01-25T00:17:18.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23062025-01-25T00:17:18.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 80.309008ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
23072025-01-25T00:17:18.497ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23082025-01-25T00:17:18.497ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23092025-01-25T00:17:18.497ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23102025-01-25T00:17:18.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23112025-01-25T00:17:18.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23122025-01-25T00:17:18.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23132025-01-25T00:17:18.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.123158ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23142025-01-25T00:17:18.500ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23152025-01-25T00:17:18.500ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23162025-01-25T00:17:18.500ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23172025-01-25T00:17:18.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23182025-01-25T00:17:18.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23192025-01-25T00:17:18.502ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23202025-01-25T00:17:18.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23212025-01-25T00:17:18.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23222025-01-25T00:17:18.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23232025-01-25T00:17:18.503ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23242025-01-25T00:17:18.503ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23252025-01-25T00:17:18.503ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23262025-01-25T00:17:18.503ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23272025-01-25T00:17:18.503ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23282025-01-25T00:17:18.503ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.439516ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23292025-01-25T00:17:18.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23302025-01-25T00:17:18.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23312025-01-25T00:17:18.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23322025-01-25T00:17:18.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23332025-01-25T00:17:18.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23342025-01-25T00:17:18.511ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23352025-01-25T00:17:18.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23362025-01-25T00:17:18.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23372025-01-25T00:17:18.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23382025-01-25T00:17:18.518ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
23392025-01-25T00:17:18.518ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.640954ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
23402025-01-25T00:17:18.522ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23412025-01-25T00:17:18.524ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.416884ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23422025-01-25T00:17:18.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
23432025-01-25T00:17:18.525ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23442025-01-25T00:17:18.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23452025-01-25T00:17:18.531ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23462025-01-25T00:17:18.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23472025-01-25T00:17:18.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23482025-01-25T00:17:18.534ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23492025-01-25T00:17:18.534ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.214636ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23502025-01-25T00:17:18.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23512025-01-25T00:17:18.549ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
23522025-01-25T00:17:18.549ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
23532025-01-25T00:17:18.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23542025-01-25T00:17:18.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23552025-01-25T00:17:18.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23562025-01-25T00:17:18.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23572025-01-25T00:17:18.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23582025-01-25T00:17:18.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23592025-01-25T00:17:18.558ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
23602025-01-25T00:17:18.558ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
23612025-01-25T00:17:18.558ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-25 00:10:46.879674 UTC dns_group = internal generation = 1
23622025-01-25T00:17:18.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 142.343171ms iteration = 8 status = {"generation":1}
23632025-01-25T00:17:18.561ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
23642025-01-25T00:17:18.561ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23652025-01-25T00:17:18.561ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ededc425-201a-4d72-9150-e45b8ae77a51", "content-length": "26", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
23662025-01-25T00:17:18.561ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23672025-01-25T00:17:18.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 146.04927ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23682025-01-25T00:17:18.564ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23692025-01-25T00:17:18.564ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23702025-01-25T00:17:18.564ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23712025-01-25T00:17:18.564ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.210681ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
23722025-01-25T00:17:18.574ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23732025-01-25T00:17:18.574ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23742025-01-25T00:17:18.574ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23752025-01-25T00:17:18.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23762025-01-25T00:17:18.574ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23772025-01-25T00:17:18.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23782025-01-25T00:17:18.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23792025-01-25T00:17:18.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23802025-01-25T00:17:18.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23812025-01-25T00:17:18.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 165.830813ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
23822025-01-25T00:17:18.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
23832025-01-25T00:17:18.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23842025-01-25T00:17:18.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23852025-01-25T00:17:18.586ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
23862025-01-25T00:17:18.586ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 170.91523ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
23872025-01-25T00:17:18.587ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 171.212562ms iteration = 15 status = 0
23882025-01-25T00:17:18.587ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23892025-01-25T00:17:18.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23902025-01-25T00:17:18.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23912025-01-25T00:17:18.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23922025-01-25T00:17:18.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23932025-01-25T00:17:18.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23942025-01-25T00:17:18.610ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
23952025-01-25T00:17:18.610ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23962025-01-25T00:17:18.610ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae3d7afb-45e1-417e-a9ea-09fece28bcc1", "content-length": "26", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
23972025-01-25T00:17:18.610ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23982025-01-25T00:17:18.613ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23992025-01-25T00:17:18.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24002025-01-25T00:17:18.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24012025-01-25T00:17:18.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24022025-01-25T00:17:18.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24032025-01-25T00:17:18.627ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24042025-01-25T00:17:18.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24052025-01-25T00:17:18.629ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24062025-01-25T00:17:18.631ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24072025-01-25T00:17:18.631ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24082025-01-25T00:17:18.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24092025-01-25T00:17:18.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24102025-01-25T00:17:18.635ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24112025-01-25T00:17:18.635ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24122025-01-25T00:17:18.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24132025-01-25T00:17:18.644ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24142025-01-25T00:17:18.646ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-25T00:10:16.530962Z, time_modified: 2025-01-25T00:10:16.530962Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }) }
24152025-01-25T00:17:18.646ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 230.200979ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]}},"default_endpoint":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
24162025-01-25T00:17:18.654ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 237.983129ms iteration = 17 status = {"physical_disks_added":0}
24172025-01-25T00:17:18.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
24182025-01-25T00:17:18.656ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24192025-01-25T00:17:18.656ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9ac620c-74b7-4ac8-b10f-14e64abbf621", "content-length": "26", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
24202025-01-25T00:17:18.656ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24212025-01-25T00:17:18.658ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
24222025-01-25T00:17:18.665ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24232025-01-25T00:17:18.665ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 0 version = 2
24242025-01-25T00:17:18.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24252025-01-25T00:17:18.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24262025-01-25T00:17:18.700ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
24272025-01-25T00:17:18.700ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 284.069599ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
24282025-01-25T00:17:18.791ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24292025-01-25T00:17:18.792ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fc8b0a5-01ab-408b-b0ef-3247a7e4699b", "content-length": "1", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
24302025-01-25T00:17:18.794ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24312025-01-25T00:17:18.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24322025-01-25T00:17:18.825ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
24332025-01-25T00:17:18.836ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24342025-01-25T00:17:18.836ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24352025-01-25T00:17:18.836ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e923790-eabf-4906-a5a1-153899bede77", "content-length": "372", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
24362025-01-25T00:17:18.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24372025-01-25T00:17:18.837ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 421.531625ms iteration = 15 status = {}
24382025-01-25T00:17:18.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24392025-01-25T00:17:18.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24402025-01-25T00:17:18.839ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 423.755856ms iteration = 15 status = null
24412025-01-25T00:17:18.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24422025-01-25T00:17:18.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24432025-01-25T00:17:18.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24442025-01-25T00:17:18.854ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24452025-01-25T00:17:18.854ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24462025-01-25T00:17:18.855ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c66f5648-4177-4912-8a90-164e25303770", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
24472025-01-25T00:17:18.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24482025-01-25T00:17:18.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24492025-01-25T00:17:18.888ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24502025-01-25T00:17:18.889ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "af87cd1c-ab40-4914-a0f2-e810a543f6db", "content-length": "691", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
24512025-01-25T00:17:18.889ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24522025-01-25T00:17:18.889ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24532025-01-25T00:17:18.889ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24542025-01-25T00:17:18.890ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 1 version = 2
24552025-01-25T00:17:18.890ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24562025-01-25T00:17:18.890ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-25 00:10:47.835608 UTC dns_group = external generation = 2
24572025-01-25T00:17:18.890ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 474.695792ms iteration = 15 status = {}
24582025-01-25T00:17:18.890ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 474.763722ms iteration = 8 status = {"generation":2}
24592025-01-25T00:17:18.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24602025-01-25T00:17:18.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24612025-01-25T00:17:18.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24622025-01-25T00:17:18.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24632025-01-25T00:17:18.898ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24642025-01-25T00:17:18.898ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24652025-01-25T00:17:18.898ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "df8ddbac-c3f6-4d39-beff-fd027bac45d2", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
24662025-01-25T00:17:18.899ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24672025-01-25T00:17:18.900ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9be668fd-6d8c-4edd-8440-56e6ef653681", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24682025-01-25T00:17:18.900ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24692025-01-25T00:17:18.904ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 487.821369ms iteration = 15 status = {}
24702025-01-25T00:17:18.904ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9b978bf1-62cc-46b2-8eba-83eaad63c82f", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24712025-01-25T00:17:18.904ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24722025-01-25T00:17:18.906ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24732025-01-25T00:17:18.906ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 490.208382ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24742025-01-25T00:17:19.001ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24752025-01-25T00:17:19.002ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0e3a4841-70c5-41ef-9e0e-1d859fec0441", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24762025-01-25T00:17:19.002ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24772025-01-25T00:17:19.004ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a99900a2-90f7-42cd-b138-3eae64996402", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24782025-01-25T00:17:19.004ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24792025-01-25T00:17:19.006ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b638cf82-9ac6-4813-9845-c587fbe3ed88", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24802025-01-25T00:17:19.006ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24812025-01-25T00:17:19.010ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
24822025-01-25T00:17:19.010ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 595.076959ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24832025-01-25T00:17:19.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24842025-01-25T00:17:19.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24852025-01-25T00:17:19.070ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
24862025-01-25T00:17:19.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24872025-01-25T00:17:19.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24882025-01-25T00:17:19.080ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24892025-01-25T00:17:19.080ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6132fa94-6769-4e6c-8a46-d005f46e2521", "content-length": "134", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
24902025-01-25T00:17:19.080ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24912025-01-25T00:17:19.080ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
24922025-01-25T00:17:19.081ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24932025-01-25T00:17:19.081ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24942025-01-25T00:17:19.081ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24952025-01-25T00:17:19.081ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24962025-01-25T00:17:19.081ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24972025-01-25T00:17:19.081ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24982025-01-25T00:17:19.081ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24992025-01-25T00:17:19.081ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25002025-01-25T00:17:19.081ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
25012025-01-25T00:17:19.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25022025-01-25T00:17:19.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25032025-01-25T00:17:19.084ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25042025-01-25T00:17:19.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7358258-c486-4371-b4a3-75830ce8009a", "content-length": "2", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
25052025-01-25T00:17:19.084ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25062025-01-25T00:17:19.084ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "676a5139-001d-4362-ba55-e86da1a02c2c", "content-length": "52", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
25072025-01-25T00:17:19.084ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
25082025-01-25T00:17:19.084ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25092025-01-25T00:17:19.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 42d31e89-bee6-4182-8efb-3c92ac5f6bcc roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25102025-01-25T00:17:19.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 42d31e89-bee6-4182-8efb-3c92ac5f6bcc resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25112025-01-25T00:17:19.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 42d31e89-bee6-4182-8efb-3c92ac5f6bcc response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25122025-01-25T00:17:19.250ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f991cb97-9409-4ce5-9f0f-18e9905d3d6f", "date": "Sat, 25 Jan 2025 00:17:18 GMT"} })
25132025-01-25T00:17:19.250ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
25142025-01-25T00:17:19.250ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25152025-01-25T00:17:19.254ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6102582-3038-4170-a956-99bdd36e60f7", "content-length": "682", "date": "Sat, 25 Jan 2025 00:17:19 GMT"} })
25162025-01-25T00:17:19.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25172025-01-25T00:17:19.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25182025-01-25T00:17:19.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25192025-01-25T00:17:19.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25202025-01-25T00:17:19.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25212025-01-25T00:17:19.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25222025-01-25T00:17:19.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25232025-01-25T00:17:19.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25242025-01-25T00:17:19.271ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 855.825496ms iteration = 15 status = {}
25252025-01-25T00:17:19.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = c8e5a5ff-3d8d-4b41-a375-1c32b571be54 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
25262025-01-25T00:17:19.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = c8e5a5ff-3d8d-4b41-a375-1c32b571be54 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
25272025-01-25T00:17:19.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = c8e5a5ff-3d8d-4b41-a375-1c32b571be54 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
25282025-01-25T00:17:20.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 414a3ec8-cda4-4a0d-be5e-2d6b11381264 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25292025-01-25T00:17:20.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 414a3ec8-cda4-4a0d-be5e-2d6b11381264 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25302025-01-25T00:17:20.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 414a3ec8-cda4-4a0d-be5e-2d6b11381264 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25312025-01-25T00:17:20.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 551 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = ed8e4334-5687-49f2-9554-d28a75252bfd response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
25322025-01-25T00:17:21.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 54aa0a03-1ad6-42d8-a22e-414ea172eba8 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25332025-01-25T00:17:21.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 54aa0a03-1ad6-42d8-a22e-414ea172eba8 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25342025-01-25T00:17:21.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 54aa0a03-1ad6-42d8-a22e-414ea172eba8 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25352025-01-25T00:17:22.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7228dabc-a3f2-47d2-a985-3e4037be30ab roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25362025-01-25T00:17:22.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7228dabc-a3f2-47d2-a985-3e4037be30ab resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25372025-01-25T00:17:22.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7228dabc-a3f2-47d2-a985-3e4037be30ab response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25382025-01-25T00:17:23.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dab7330c-7f17-46a8-9b43-0433241343eb roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25392025-01-25T00:17:23.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dab7330c-7f17-46a8-9b43-0433241343eb resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25402025-01-25T00:17:23.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dab7330c-7f17-46a8-9b43-0433241343eb response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25412025-01-25T00:17:24.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 68368ded-072e-43c8-96e2-34919bd77b58 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25422025-01-25T00:17:24.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 68368ded-072e-43c8-96e2-34919bd77b58 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25432025-01-25T00:17:24.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 68368ded-072e-43c8-96e2-34919bd77b58 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25442025-01-25T00:17:25.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b991cc5b-35c3-4a27-b757-9979b4e3aed0 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25452025-01-25T00:17:25.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b991cc5b-35c3-4a27-b757-9979b4e3aed0 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25462025-01-25T00:17:25.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b991cc5b-35c3-4a27-b757-9979b4e3aed0 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25472025-01-25T00:17:26.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e465477b-5103-474d-bf63-3f4a00e5ba4d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25482025-01-25T00:17:26.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e465477b-5103-474d-bf63-3f4a00e5ba4d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25492025-01-25T00:17:26.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e465477b-5103-474d-bf63-3f4a00e5ba4d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25502025-01-25T00:17:27.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = af9cca72-bc22-46bc-9e36-a842e9569922 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25512025-01-25T00:17:27.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = af9cca72-bc22-46bc-9e36-a842e9569922 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25522025-01-25T00:17:27.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = af9cca72-bc22-46bc-9e36-a842e9569922 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25532025-01-25T00:17:28.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = af320a55-dfb8-4b37-b4ed-b6dfad95c939 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25542025-01-25T00:17:28.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = af320a55-dfb8-4b37-b4ed-b6dfad95c939 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25552025-01-25T00:17:28.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = af320a55-dfb8-4b37-b4ed-b6dfad95c939 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25562025-01-25T00:17:28.415ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
25572025-01-25T00:17:28.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25582025-01-25T00:17:28.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25592025-01-25T00:17:28.416ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
25602025-01-25T00:17:28.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25612025-01-25T00:17:28.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25622025-01-25T00:17:28.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25632025-01-25T00:17:28.418ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25642025-01-25T00:17:28.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25652025-01-25T00:17:28.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25662025-01-25T00:17:28.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25672025-01-25T00:17:28.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25682025-01-25T00:17:28.420ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.81386ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25692025-01-25T00:17:28.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25702025-01-25T00:17:28.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25712025-01-25T00:17:28.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25722025-01-25T00:17:28.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
25732025-01-25T00:17:28.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25742025-01-25T00:17:28.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25752025-01-25T00:17:28.433ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
25762025-01-25T00:17:28.433ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.676922ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
25772025-01-25T00:17:29.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3724e63b-63ef-4735-a3d6-449ca1b770f0 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25782025-01-25T00:17:29.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3724e63b-63ef-4735-a3d6-449ca1b770f0 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25792025-01-25T00:17:29.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3724e63b-63ef-4735-a3d6-449ca1b770f0 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25802025-01-25T00:17:30.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bdc80f6-39aa-4403-a8a6-5bf6ab61aa2a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25812025-01-25T00:17:30.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bdc80f6-39aa-4403-a8a6-5bf6ab61aa2a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25822025-01-25T00:17:30.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bdc80f6-39aa-4403-a8a6-5bf6ab61aa2a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25832025-01-25T00:17:30.979ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 470 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = cb8e44f0-e8ff-4e20-8507-65f397ebbc44 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
25842025-01-25T00:17:31.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 73a8ed63-05fa-4717-8587-7912b0fde9f2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25852025-01-25T00:17:31.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 73a8ed63-05fa-4717-8587-7912b0fde9f2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25862025-01-25T00:17:31.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 73a8ed63-05fa-4717-8587-7912b0fde9f2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25872025-01-25T00:17:32.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99570120-e7a8-40b8-afa2-b52c8b2f6c93 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25882025-01-25T00:17:32.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99570120-e7a8-40b8-afa2-b52c8b2f6c93 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25892025-01-25T00:17:32.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99570120-e7a8-40b8-afa2-b52c8b2f6c93 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25902025-01-25T00:17:33.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9d906c98-3ba1-43da-99f0-1867bf3a761e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25912025-01-25T00:17:33.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9d906c98-3ba1-43da-99f0-1867bf3a761e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25922025-01-25T00:17:33.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9d906c98-3ba1-43da-99f0-1867bf3a761e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25932025-01-25T00:17:34.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6721da29-8e55-4082-abe2-1d7d7c05753c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25942025-01-25T00:17:34.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6721da29-8e55-4082-abe2-1d7d7c05753c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25952025-01-25T00:17:34.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6721da29-8e55-4082-abe2-1d7d7c05753c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25962025-01-25T00:17:35.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b1bf0c6d-17c3-4059-81e5-7f8d4e74c026 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25972025-01-25T00:17:35.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b1bf0c6d-17c3-4059-81e5-7f8d4e74c026 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25982025-01-25T00:17:35.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b1bf0c6d-17c3-4059-81e5-7f8d4e74c026 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
25992025-01-25T00:17:36.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 007b4244-b178-4071-a2aa-2d130033a09e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26002025-01-25T00:17:36.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 007b4244-b178-4071-a2aa-2d130033a09e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26012025-01-25T00:17:36.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 007b4244-b178-4071-a2aa-2d130033a09e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26022025-01-25T00:17:37.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9c06a42d-1c85-4c70-b311-7e9ec3753df0 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26032025-01-25T00:17:37.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9c06a42d-1c85-4c70-b311-7e9ec3753df0 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26042025-01-25T00:17:37.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9c06a42d-1c85-4c70-b311-7e9ec3753df0 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26052025-01-25T00:17:38.415ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
26062025-01-25T00:17:38.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26072025-01-25T00:17:38.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26082025-01-25T00:17:38.416ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
26092025-01-25T00:17:38.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26102025-01-25T00:17:38.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26112025-01-25T00:17:38.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26122025-01-25T00:17:38.418ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26132025-01-25T00:17:38.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26142025-01-25T00:17:38.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26152025-01-25T00:17:38.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26162025-01-25T00:17:38.419ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.487798ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26172025-01-25T00:17:38.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26182025-01-25T00:17:38.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26192025-01-25T00:17:38.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26202025-01-25T00:17:38.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26212025-01-25T00:17:38.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
26222025-01-25T00:17:38.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26232025-01-25T00:17:38.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26242025-01-25T00:17:38.433ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
26252025-01-25T00:17:38.433ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.470567ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
26262025-01-25T00:17:38.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 07969442-4b80-42f4-9d6f-873a82e11257 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26272025-01-25T00:17:38.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 07969442-4b80-42f4-9d6f-873a82e11257 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26282025-01-25T00:17:38.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 07969442-4b80-42f4-9d6f-873a82e11257 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26292025-01-25T00:17:39.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9913841c-424a-4ca4-b9e8-b37b8e47a3e2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26302025-01-25T00:17:39.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9913841c-424a-4ca4-b9e8-b37b8e47a3e2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26312025-01-25T00:17:39.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9913841c-424a-4ca4-b9e8-b37b8e47a3e2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26322025-01-25T00:17:40.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7616c928-a26d-4827-9a62-a3e1bd4ceb7d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26332025-01-25T00:17:40.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7616c928-a26d-4827-9a62-a3e1bd4ceb7d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26342025-01-25T00:17:40.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1586 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7616c928-a26d-4827-9a62-a3e1bd4ceb7d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26352025-01-25T00:17:40.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 501 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 4b52e01a-5eaa-4435-9312-e7ddf80c8bed response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
26362025-01-25T00:17:41.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a435d93b-114e-482c-b0d0-62b432a8288c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26372025-01-25T00:17:41.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a435d93b-114e-482c-b0d0-62b432a8288c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26382025-01-25T00:17:41.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a435d93b-114e-482c-b0d0-62b432a8288c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26392025-01-25T00:17:42.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c67095f-a45e-43b7-a18d-68eb0728864a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26402025-01-25T00:17:42.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c67095f-a45e-43b7-a18d-68eb0728864a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26412025-01-25T00:17:42.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2766 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c67095f-a45e-43b7-a18d-68eb0728864a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26422025-01-25T00:17:43.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b848e8bc-c152-47fc-9646-a20e22adafa1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26432025-01-25T00:17:43.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b848e8bc-c152-47fc-9646-a20e22adafa1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26442025-01-25T00:17:43.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b848e8bc-c152-47fc-9646-a20e22adafa1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26452025-01-25T00:17:44.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 10ceffc1-a4a3-44c6-a497-617060a31339 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26462025-01-25T00:17:44.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 10ceffc1-a4a3-44c6-a497-617060a31339 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26472025-01-25T00:17:44.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 10ceffc1-a4a3-44c6-a497-617060a31339 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26482025-01-25T00:17:45.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 29da7356-3896-4fa2-b7dc-59882d3365cc roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26492025-01-25T00:17:45.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 29da7356-3896-4fa2-b7dc-59882d3365cc resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26502025-01-25T00:17:45.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 29da7356-3896-4fa2-b7dc-59882d3365cc response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26512025-01-25T00:17:46.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dfc07565-39fb-4833-9152-4bee6a571522 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26522025-01-25T00:17:46.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dfc07565-39fb-4833-9152-4bee6a571522 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26532025-01-25T00:17:46.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dfc07565-39fb-4833-9152-4bee6a571522 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26542025-01-25T00:17:47.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3527072b-b44a-41b2-abde-bcc4970d7cb2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26552025-01-25T00:17:47.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3527072b-b44a-41b2-abde-bcc4970d7cb2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26562025-01-25T00:17:47.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3527072b-b44a-41b2-abde-bcc4970d7cb2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
26572025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
26582025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
26592025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26602025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
26612025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
26622025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26632025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26642025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
26652025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26662025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
26672025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26682025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
26692025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
26702025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26712025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26722025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
26732025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
26742025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26752025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26762025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26772025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26782025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26792025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26802025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26812025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26822025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26832025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26842025-01-25T00:17:48.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26852025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
26862025-01-25T00:17:48.417ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26872025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
26882025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26892025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
26902025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26912025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26922025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
26932025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26942025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
26952025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26962025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
26972025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26982025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
26992025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27002025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
27012025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27022025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27032025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27042025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27052025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27062025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27072025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27082025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27092025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27102025-01-25T00:17:48.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27112025-01-25T00:17:48.418ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27122025-01-25T00:17:48.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27132025-01-25T00:17:48.419ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1391, tv_nsec: 142990350 } })
27142025-01-25T00:17:48.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27152025-01-25T00:17:48.419ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
27162025-01-25T00:17:48.420ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.104061ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27172025-01-25T00:17:48.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27182025-01-25T00:17:48.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
27192025-01-25T00:17:48.421ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27202025-01-25T00:17:48.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27212025-01-25T00:17:48.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27222025-01-25T00:17:48.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27232025-01-25T00:17:48.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27242025-01-25T00:17:48.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27252025-01-25T00:17:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27262025-01-25T00:17:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27272025-01-25T00:17:48.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27282025-01-25T00:17:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27292025-01-25T00:17:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27302025-01-25T00:17:48.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27312025-01-25T00:17:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27322025-01-25T00:17:48.425ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1391, tv_nsec: 149208762 } })
27332025-01-25T00:17:48.425ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
27342025-01-25T00:17:48.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.450224ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
27352025-01-25T00:17:48.426ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27362025-01-25T00:17:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27372025-01-25T00:17:48.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27382025-01-25T00:17:48.429ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1391, tv_nsec: 153644335 } })
27392025-01-25T00:17:48.430ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
27402025-01-25T00:17:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27412025-01-25T00:17:48.430ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27422025-01-25T00:17:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27432025-01-25T00:17:48.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27442025-01-25T00:17:48.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27452025-01-25T00:17:48.433ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27462025-01-25T00:17:48.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27472025-01-25T00:17:48.435ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27482025-01-25T00:17:48.436ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27492025-01-25T00:17:48.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27502025-01-25T00:17:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27512025-01-25T00:17:48.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27522025-01-25T00:17:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27532025-01-25T00:17:48.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27542025-01-25T00:17:48.476ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27552025-01-25T00:17:48.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27562025-01-25T00:17:48.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27572025-01-25T00:17:48.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27582025-01-25T00:17:48.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27592025-01-25T00:17:48.479ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27602025-01-25T00:17:48.479ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27612025-01-25T00:17:48.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27622025-01-25T00:17:48.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27632025-01-25T00:17:48.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
27642025-01-25T00:17:48.482ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27652025-01-25T00:17:48.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27662025-01-25T00:17:48.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27672025-01-25T00:17:48.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27682025-01-25T00:17:48.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
27692025-01-25T00:17:48.486ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27702025-01-25T00:17:48.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27712025-01-25T00:17:48.488ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.742098ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
27722025-01-25T00:17:48.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27732025-01-25T00:17:48.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27742025-01-25T00:17:48.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27752025-01-25T00:17:48.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27762025-01-25T00:17:48.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772025-01-25T00:17:48.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27782025-01-25T00:17:48.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27792025-01-25T00:17:48.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.693524ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27802025-01-25T00:17:48.494ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27812025-01-25T00:17:48.494ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.555134ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27822025-01-25T00:17:48.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27832025-01-25T00:17:48.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27842025-01-25T00:17:48.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27852025-01-25T00:17:48.498ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27862025-01-25T00:17:48.498ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27872025-01-25T00:17:48.498ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27882025-01-25T00:17:48.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27892025-01-25T00:17:48.499ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27902025-01-25T00:17:48.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27912025-01-25T00:17:48.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.180128ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27922025-01-25T00:17:48.501ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27932025-01-25T00:17:48.501ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27942025-01-25T00:17:48.501ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27952025-01-25T00:17:48.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.538076ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27962025-01-25T00:17:48.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27972025-01-25T00:17:48.504ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
27982025-01-25T00:17:48.504ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.785902ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
27992025-01-25T00:17:48.512ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
28002025-01-25T00:17:48.512ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28012025-01-25T00:17:48.512ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
28022025-01-25T00:17:48.512ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28032025-01-25T00:17:48.512ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bc50ffe-4288-4db9-aba9-911eb2fe6f8a", "content-length": "26", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28042025-01-25T00:17:48.512ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
28052025-01-25T00:17:48.512ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28062025-01-25T00:17:48.512ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28072025-01-25T00:17:48.513ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6da6dc28-e21a-4712-aa67-54cf68655e12", "content-length": "26", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28082025-01-25T00:17:48.513ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28092025-01-25T00:17:48.513ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e905cdeb-22a0-46e5-840b-3c3efcc8a859", "content-length": "26", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28102025-01-25T00:17:48.513ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28112025-01-25T00:17:48.515ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28122025-01-25T00:17:48.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
28132025-01-25T00:17:48.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28142025-01-25T00:17:48.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28152025-01-25T00:17:48.522ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28162025-01-25T00:17:48.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28172025-01-25T00:17:48.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28182025-01-25T00:17:48.536ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28192025-01-25T00:17:48.538ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
28202025-01-25T00:17:48.538ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 122.261676ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
28212025-01-25T00:17:48.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
28222025-01-25T00:17:48.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28232025-01-25T00:17:48.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28242025-01-25T00:17:48.543ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 127.479564ms iteration = 16 status = 0
28252025-01-25T00:17:48.560ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28262025-01-25T00:17:48.560ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28272025-01-25T00:17:48.560ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.664373ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28282025-01-25T00:17:48.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 158.568625ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
28292025-01-25T00:17:48.591ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 175.748715ms iteration = 16 status = {}
28302025-01-25T00:17:48.603ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 187.551247ms iteration = 18 status = {"physical_disks_added":0}
28312025-01-25T00:17:48.608ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28322025-01-25T00:17:48.609ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ec62ac3-7c2c-45e3-80c4-9a323eab85c5", "content-length": "1", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28332025-01-25T00:17:48.610ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28342025-01-25T00:17:48.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28352025-01-25T00:17:48.617ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28362025-01-25T00:17:48.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28372025-01-25T00:17:48.674ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28382025-01-25T00:17:48.674ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28392025-01-25T00:17:48.674ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d7d709c-5493-4959-b05d-673a59141468", "content-length": "372", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28402025-01-25T00:17:48.674ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28412025-01-25T00:17:48.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28422025-01-25T00:17:48.675ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 259.524732ms iteration = 16 status = null
28432025-01-25T00:17:48.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28442025-01-25T00:17:48.678ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28452025-01-25T00:17:48.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28462025-01-25T00:17:48.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28472025-01-25T00:17:48.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28482025-01-25T00:17:48.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28492025-01-25T00:17:48.682ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28502025-01-25T00:17:48.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28512025-01-25T00:17:48.689ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
28522025-01-25T00:17:48.689ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28532025-01-25T00:17:48.689ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d14109b6-3c04-4ffd-823c-db598d1a833f", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28542025-01-25T00:17:48.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28552025-01-25T00:17:48.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28562025-01-25T00:17:48.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28572025-01-25T00:17:48.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28582025-01-25T00:17:48.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28592025-01-25T00:17:48.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28602025-01-25T00:17:48.697ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28612025-01-25T00:17:48.697ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28622025-01-25T00:17:48.698ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e2c6c86d-1210-4c09-897c-6efceb1e9f5a", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28632025-01-25T00:17:48.700ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 282.779242ms iteration = 16 status = {}
28642025-01-25T00:17:48.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28652025-01-25T00:17:48.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28662025-01-25T00:17:48.718ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28672025-01-25T00:17:48.719ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "843c9170-9ad9-4a95-956b-a551cb080e8f", "content-length": "691", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28682025-01-25T00:17:48.719ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28692025-01-25T00:17:48.719ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28702025-01-25T00:17:48.719ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28712025-01-25T00:17:48.720ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
28722025-01-25T00:17:48.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28732025-01-25T00:17:48.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28742025-01-25T00:17:48.721ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 304.976378ms iteration = 16 status = {}
28752025-01-25T00:17:48.729ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28762025-01-25T00:17:48.730ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1187740b-dfdd-4f0c-a872-3380d84750ea", "content-length": "134", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28772025-01-25T00:17:48.730ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28782025-01-25T00:17:48.730ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
28792025-01-25T00:17:48.730ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28802025-01-25T00:17:48.730ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28812025-01-25T00:17:48.730ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28822025-01-25T00:17:48.730ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28832025-01-25T00:17:48.730ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28842025-01-25T00:17:48.730ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28852025-01-25T00:17:48.730ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28862025-01-25T00:17:48.730ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28872025-01-25T00:17:48.730ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
28882025-01-25T00:17:48.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28892025-01-25T00:17:48.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28902025-01-25T00:17:48.732ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28912025-01-25T00:17:48.732ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fa8170a-2ae3-4087-a8b0-dcbe6a9b5bbb", "content-length": "2", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28922025-01-25T00:17:48.732ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28932025-01-25T00:17:48.732ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a391bb82-9cf4-4ecf-a173-bcdc34409128", "content-length": "52", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28942025-01-25T00:17:48.732ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
28952025-01-25T00:17:48.732ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28962025-01-25T00:17:48.833ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f4443d4d-34a8-4318-b977-e753f67e903a", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
28972025-01-25T00:17:48.833ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
28982025-01-25T00:17:48.833ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28992025-01-25T00:17:48.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 71478b8a-185c-4eb9-afe6-72cf68defad1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29002025-01-25T00:17:48.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 71478b8a-185c-4eb9-afe6-72cf68defad1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29012025-01-25T00:17:48.834ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3886fb68-897c-4633-9877-cabf139c5490", "content-length": "682", "date": "Sat, 25 Jan 2025 00:17:48 GMT"} })
29022025-01-25T00:17:48.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29032025-01-25T00:17:48.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29042025-01-25T00:17:48.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 71478b8a-185c-4eb9-afe6-72cf68defad1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29052025-01-25T00:17:48.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29062025-01-25T00:17:48.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29072025-01-25T00:17:48.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29082025-01-25T00:17:48.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29092025-01-25T00:17:48.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29102025-01-25T00:17:48.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29112025-01-25T00:17:48.864ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 447.985122ms iteration = 16 status = {}
29122025-01-25T00:17:49.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 580c8594-8d3e-42a5-bd81-83af18bdb992 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
29132025-01-25T00:17:49.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 580c8594-8d3e-42a5-bd81-83af18bdb992 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
29142025-01-25T00:17:49.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 580c8594-8d3e-42a5-bd81-83af18bdb992 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
29152025-01-25T00:17:49.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 61f2d92a-28c4-449c-af2a-e274b29c1123 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29162025-01-25T00:17:49.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 61f2d92a-28c4-449c-af2a-e274b29c1123 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29172025-01-25T00:17:49.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 61f2d92a-28c4-449c-af2a-e274b29c1123 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29182025-01-25T00:17:50.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 894ba9e0-fa5a-422c-a6fd-33ba5798c745 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29192025-01-25T00:17:50.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 894ba9e0-fa5a-422c-a6fd-33ba5798c745 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29202025-01-25T00:17:50.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 894ba9e0-fa5a-422c-a6fd-33ba5798c745 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29212025-01-25T00:17:50.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 575 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 43a84456-440a-4670-8eea-49cbe4cc5480 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
29222025-01-25T00:17:51.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5e679e5e-c0c6-42de-b730-225dce10aa6e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29232025-01-25T00:17:51.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5e679e5e-c0c6-42de-b730-225dce10aa6e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29242025-01-25T00:17:51.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5e679e5e-c0c6-42de-b730-225dce10aa6e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29252025-01-25T00:17:52.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bc8aa95f-ea50-4f06-955b-13d3e7136be3 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29262025-01-25T00:17:52.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bc8aa95f-ea50-4f06-955b-13d3e7136be3 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29272025-01-25T00:17:52.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bc8aa95f-ea50-4f06-955b-13d3e7136be3 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29282025-01-25T00:17:53.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 223db186-291f-4e6d-bce3-cca488eb7ac7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29292025-01-25T00:17:53.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 223db186-291f-4e6d-bce3-cca488eb7ac7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29302025-01-25T00:17:53.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 223db186-291f-4e6d-bce3-cca488eb7ac7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29312025-01-25T00:17:54.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 14ab00e5-7478-4f2e-b66b-16f8d9586245 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29322025-01-25T00:17:54.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 14ab00e5-7478-4f2e-b66b-16f8d9586245 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29332025-01-25T00:17:54.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 14ab00e5-7478-4f2e-b66b-16f8d9586245 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29342025-01-25T00:17:56.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ec53bebc-6088-49c3-a7be-77c87e69b4f4 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29352025-01-25T00:17:56.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ec53bebc-6088-49c3-a7be-77c87e69b4f4 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29362025-01-25T00:17:56.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ec53bebc-6088-49c3-a7be-77c87e69b4f4 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29372025-01-25T00:17:57.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9b8a87a7-afd5-4633-8af2-d4576dcbb161 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29382025-01-25T00:17:57.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9b8a87a7-afd5-4633-8af2-d4576dcbb161 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29392025-01-25T00:17:57.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9b8a87a7-afd5-4633-8af2-d4576dcbb161 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29402025-01-25T00:17:58.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 963d8cc4-670b-4482-8889-b9dc5bf71938 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29412025-01-25T00:17:58.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 963d8cc4-670b-4482-8889-b9dc5bf71938 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29422025-01-25T00:17:58.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 963d8cc4-670b-4482-8889-b9dc5bf71938 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29432025-01-25T00:17:58.416ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
29442025-01-25T00:17:58.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29452025-01-25T00:17:58.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29462025-01-25T00:17:58.417ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
29472025-01-25T00:17:58.417ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29482025-01-25T00:17:58.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29492025-01-25T00:17:58.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502025-01-25T00:17:58.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29512025-01-25T00:17:58.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29522025-01-25T00:17:58.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29532025-01-25T00:17:58.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29542025-01-25T00:17:58.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29552025-01-25T00:17:58.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29562025-01-25T00:17:58.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
29572025-01-25T00:17:58.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29582025-01-25T00:17:58.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29592025-01-25T00:17:58.437ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
29602025-01-25T00:17:58.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.796828ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
29612025-01-25T00:17:58.451ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29622025-01-25T00:17:58.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29632025-01-25T00:17:58.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.906778ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29642025-01-25T00:17:59.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = de9e8d6e-50f4-41d9-b619-de8a4db157a2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29652025-01-25T00:17:59.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = de9e8d6e-50f4-41d9-b619-de8a4db157a2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29662025-01-25T00:17:59.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = de9e8d6e-50f4-41d9-b619-de8a4db157a2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29672025-01-25T00:18:00.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1dcd18e3-3aad-41e8-aaad-e9b26941d21c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29682025-01-25T00:18:00.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1dcd18e3-3aad-41e8-aaad-e9b26941d21c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29692025-01-25T00:18:00.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1dcd18e3-3aad-41e8-aaad-e9b26941d21c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29702025-01-25T00:18:00.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 478 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = d08c9bf1-fe59-4bbf-b255-7c5f71055281 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
29712025-01-25T00:18:01.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c44d718d-7ebc-407c-93c9-dfc9b719cc20 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29722025-01-25T00:18:01.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c44d718d-7ebc-407c-93c9-dfc9b719cc20 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29732025-01-25T00:18:01.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c44d718d-7ebc-407c-93c9-dfc9b719cc20 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29742025-01-25T00:18:02.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a80e64a-023c-45ab-8547-8bcc1ab33f86 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29752025-01-25T00:18:02.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a80e64a-023c-45ab-8547-8bcc1ab33f86 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29762025-01-25T00:18:02.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a80e64a-023c-45ab-8547-8bcc1ab33f86 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29772025-01-25T00:18:03.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0d98ee30-cc3b-4529-bdac-6c4ca4c44d87 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29782025-01-25T00:18:03.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0d98ee30-cc3b-4529-bdac-6c4ca4c44d87 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29792025-01-25T00:18:03.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0d98ee30-cc3b-4529-bdac-6c4ca4c44d87 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29802025-01-25T00:18:04.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a8c1eda8-e41e-4565-9907-cabf62fbfb84 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29812025-01-25T00:18:04.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a8c1eda8-e41e-4565-9907-cabf62fbfb84 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29822025-01-25T00:18:04.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a8c1eda8-e41e-4565-9907-cabf62fbfb84 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29832025-01-25T00:18:05.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 19b9a4c8-d7ad-44ac-8808-4afbb6c6d102 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29842025-01-25T00:18:05.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 19b9a4c8-d7ad-44ac-8808-4afbb6c6d102 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29852025-01-25T00:18:05.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 19b9a4c8-d7ad-44ac-8808-4afbb6c6d102 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29862025-01-25T00:18:06.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69c993b8-ea0d-485e-84e8-2fc69b68da7a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29872025-01-25T00:18:06.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69c993b8-ea0d-485e-84e8-2fc69b68da7a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29882025-01-25T00:18:06.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69c993b8-ea0d-485e-84e8-2fc69b68da7a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29892025-01-25T00:18:07.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a6542e4d-14ed-4df4-b3e1-2a7bb8008e3a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29902025-01-25T00:18:07.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a6542e4d-14ed-4df4-b3e1-2a7bb8008e3a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29912025-01-25T00:18:07.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a6542e4d-14ed-4df4-b3e1-2a7bb8008e3a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29922025-01-25T00:18:08.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7b438700-9a5b-43bb-ad53-6c0ddd82ea33 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29932025-01-25T00:18:08.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7b438700-9a5b-43bb-ad53-6c0ddd82ea33 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29942025-01-25T00:18:08.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7b438700-9a5b-43bb-ad53-6c0ddd82ea33 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
29952025-01-25T00:18:08.416ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
29962025-01-25T00:18:08.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29972025-01-25T00:18:08.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29982025-01-25T00:18:08.417ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
29992025-01-25T00:18:08.417ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30002025-01-25T00:18:08.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30012025-01-25T00:18:08.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30022025-01-25T00:18:08.418ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30032025-01-25T00:18:08.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30042025-01-25T00:18:08.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30052025-01-25T00:18:08.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30062025-01-25T00:18:08.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30072025-01-25T00:18:08.421ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.932661ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30082025-01-25T00:18:08.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30092025-01-25T00:18:08.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30102025-01-25T00:18:08.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30112025-01-25T00:18:08.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
30122025-01-25T00:18:08.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30132025-01-25T00:18:08.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30142025-01-25T00:18:08.439ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
30152025-01-25T00:18:08.439ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.869369ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
30162025-01-25T00:18:09.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8f998184-8921-4335-b1db-f5f7716bd92a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30172025-01-25T00:18:09.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8f998184-8921-4335-b1db-f5f7716bd92a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30182025-01-25T00:18:09.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8f998184-8921-4335-b1db-f5f7716bd92a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30192025-01-25T00:18:10.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8c970d0b-59a7-42fc-87fa-519c34317bcc roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30202025-01-25T00:18:10.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8c970d0b-59a7-42fc-87fa-519c34317bcc resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30212025-01-25T00:18:10.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8c970d0b-59a7-42fc-87fa-519c34317bcc response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30222025-01-25T00:18:10.980ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = e66413fb-9752-4f28-95a2-c2908e6f5a90 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
30232025-01-25T00:18:11.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8c9f6178-2db7-4014-bef3-5f8570e2d01f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30242025-01-25T00:18:11.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8c9f6178-2db7-4014-bef3-5f8570e2d01f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30252025-01-25T00:18:11.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8c9f6178-2db7-4014-bef3-5f8570e2d01f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30262025-01-25T00:18:12.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9066b32a-ec29-43b4-89f7-24fe47e8fef3 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30272025-01-25T00:18:12.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9066b32a-ec29-43b4-89f7-24fe47e8fef3 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30282025-01-25T00:18:12.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1769 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9066b32a-ec29-43b4-89f7-24fe47e8fef3 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30292025-01-25T00:18:13.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 90ddf601-00ee-4457-ab33-a9b348ce608d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30302025-01-25T00:18:13.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 90ddf601-00ee-4457-ab33-a9b348ce608d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30312025-01-25T00:18:13.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 90ddf601-00ee-4457-ab33-a9b348ce608d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30322025-01-25T00:18:14.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d05ac18a-d67a-47a9-9844-15a7b08362cb roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30332025-01-25T00:18:14.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d05ac18a-d67a-47a9-9844-15a7b08362cb resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30342025-01-25T00:18:14.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d05ac18a-d67a-47a9-9844-15a7b08362cb response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30352025-01-25T00:18:15.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4f0dafc2-fe32-4832-a75b-a51dbe515344 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30362025-01-25T00:18:15.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4f0dafc2-fe32-4832-a75b-a51dbe515344 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30372025-01-25T00:18:15.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1781 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4f0dafc2-fe32-4832-a75b-a51dbe515344 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30382025-01-25T00:18:15.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = d9cc12c5-c5c8-45c1-b2b6-a3eb69c30087 roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
30392025-01-25T00:18:15.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = d9cc12c5-c5c8-45c1-b2b6-a3eb69c30087 resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
30402025-01-25T00:18:15.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = d9cc12c5-c5c8-45c1-b2b6-a3eb69c30087 response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
30412025-01-25T00:18:15.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = bd8a5580-197a-4808-915d-66e5458bd4ea roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
30422025-01-25T00:18:15.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = bd8a5580-197a-4808-915d-66e5458bd4ea resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
30432025-01-25T00:18:15.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = bd8a5580-197a-4808-915d-66e5458bd4ea response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
30442025-01-25T00:18:16.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e4e09716-6ee5-4a0f-a7b6-bba7957bcb2d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30452025-01-25T00:18:16.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e4e09716-6ee5-4a0f-a7b6-bba7957bcb2d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30462025-01-25T00:18:16.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e4e09716-6ee5-4a0f-a7b6-bba7957bcb2d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30472025-01-25T00:18:17.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 15043f55-a796-402f-b87f-1d5ec2236413 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30482025-01-25T00:18:17.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 15043f55-a796-402f-b87f-1d5ec2236413 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30492025-01-25T00:18:17.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 15043f55-a796-402f-b87f-1d5ec2236413 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
30502025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
30512025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
30522025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
30532025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
30542025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30552025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30562025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
30572025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30582025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
30592025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30602025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
30612025-01-25T00:18:18.417ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2
30622025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.13\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2"}
30632025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
30642025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
30652025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
30662025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
30672025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30682025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
30692025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30702025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30712025-01-25T00:18:18.417ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-25 00:08:18.417403550 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30722025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30732025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
30742025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
30752025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30762025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
30772025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30782025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
30792025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30802025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
30812025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30822025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
30832025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
30842025-01-25T00:18:18.417ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
30852025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30862025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
30872025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
30882025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30892025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30902025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
30912025-01-25T00:18:18.417ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30922025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30932025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
30942025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30952025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30962025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
30972025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30982025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
30992025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
31002025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31012025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31022025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
31032025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31042025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
31052025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31062025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
31072025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31082025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
31092025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
31102025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31112025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31122025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
31132025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31142025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31152025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31162025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31172025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31182025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31192025-01-25T00:18:18.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31202025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31212025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31222025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31232025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31242025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31252025-01-25T00:18:18.418ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("167a4f68-f407-48e5-a9a6-22f96a22bf2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3a6aa3c-ea79-4881-9aa5-b12ba496f837.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1421, tv_nsec: 141040780 } })
31262025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31272025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31282025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31292025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31302025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31312025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31322025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31332025-01-25T00:18:18.418ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22685765-7656-499f-8835-1c19f38e16e6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1421, tv_nsec: 141138850 } })
31342025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31352025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31362025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31372025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31382025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31392025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31402025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
31412025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
31422025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.232477ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
31432025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
31442025-01-25T00:18:18.418ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.188246ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
31452025-01-25T00:18:18.420ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1421, tv_nsec: 143552453 } })
31462025-01-25T00:18:18.420ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
31472025-01-25T00:18:18.421ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1421, tv_nsec: 143956565 } })
31482025-01-25T00:18:18.421ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
31492025-01-25T00:18:18.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31502025-01-25T00:18:18.422ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-25 00:08:18.417403550 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
31512025-01-25T00:18:18.422ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.750915ms iteration = 9 status = {"expiration":"2025-01-25T00:08:18.417403550Z","pruned":[]}
31522025-01-25T00:18:18.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31532025-01-25T00:18:18.422ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31542025-01-25T00:18:18.422ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.216647ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31552025-01-25T00:18:18.423ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31562025-01-25T00:18:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31572025-01-25T00:18:18.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31582025-01-25T00:18:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31592025-01-25T00:18:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31602025-01-25T00:18:18.425ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31612025-01-25T00:18:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
31622025-01-25T00:18:18.425ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31632025-01-25T00:18:18.425ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31642025-01-25T00:18:18.425ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31652025-01-25T00:18:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31662025-01-25T00:18:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31672025-01-25T00:18:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31682025-01-25T00:18:18.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31692025-01-25T00:18:18.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31702025-01-25T00:18:18.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31712025-01-25T00:18:18.428ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31722025-01-25T00:18:18.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31732025-01-25T00:18:18.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31742025-01-25T00:18:18.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31752025-01-25T00:18:18.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31762025-01-25T00:18:18.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31772025-01-25T00:18:18.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31782025-01-25T00:18:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
31792025-01-25T00:18:18.431ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31802025-01-25T00:18:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31812025-01-25T00:18:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31822025-01-25T00:18:18.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.859212ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
31832025-01-25T00:18:18.431ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31842025-01-25T00:18:18.431ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31852025-01-25T00:18:18.431ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31862025-01-25T00:18:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31872025-01-25T00:18:18.433ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.786333ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
31882025-01-25T00:18:18.436ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.927738ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
31892025-01-25T00:18:18.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31902025-01-25T00:18:18.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31912025-01-25T00:18:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31922025-01-25T00:18:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31932025-01-25T00:18:18.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31942025-01-25T00:18:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31952025-01-25T00:18:18.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31962025-01-25T00:18:18.440ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31972025-01-25T00:18:18.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31982025-01-25T00:18:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31992025-01-25T00:18:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32002025-01-25T00:18:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32012025-01-25T00:18:18.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32022025-01-25T00:18:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32032025-01-25T00:18:18.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32042025-01-25T00:18:18.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32052025-01-25T00:18:18.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1421, tv_nsec: 173045307 } })
32062025-01-25T00:18:18.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
32072025-01-25T00:18:18.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082025-01-25T00:18:18.454ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32092025-01-25T00:18:18.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32102025-01-25T00:18:18.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32112025-01-25T00:18:18.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32122025-01-25T00:18:18.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32132025-01-25T00:18:18.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32142025-01-25T00:18:18.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32152025-01-25T00:18:18.468ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32162025-01-25T00:18:18.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32172025-01-25T00:18:18.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32182025-01-25T00:18:18.479ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32192025-01-25T00:18:18.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32202025-01-25T00:18:18.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32212025-01-25T00:18:18.480ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32222025-01-25T00:18:18.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32232025-01-25T00:18:18.483ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32242025-01-25T00:18:18.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32252025-01-25T00:18:18.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32262025-01-25T00:18:18.488ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32272025-01-25T00:18:18.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32282025-01-25T00:18:18.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32292025-01-25T00:18:18.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6badd77f-c5bf-4336-85bf-302c5a3d2bce roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
32302025-01-25T00:18:18.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6badd77f-c5bf-4336-85bf-302c5a3d2bce resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
32312025-01-25T00:18:18.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32322025-01-25T00:18:18.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6badd77f-c5bf-4336-85bf-302c5a3d2bce response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
32332025-01-25T00:18:18.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32342025-01-25T00:18:18.495ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32352025-01-25T00:18:18.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32362025-01-25T00:18:18.506ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32372025-01-25T00:18:18.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32382025-01-25T00:18:18.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32392025-01-25T00:18:18.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32402025-01-25T00:18:18.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32412025-01-25T00:18:18.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32422025-01-25T00:18:18.525ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
32432025-01-25T00:18:18.526ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
32442025-01-25T00:18:18.526ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
32452025-01-25T00:18:18.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32462025-01-25T00:18:18.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32472025-01-25T00:18:18.527ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32482025-01-25T00:18:18.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32492025-01-25T00:18:18.528ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
32502025-01-25T00:18:18.528ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
32512025-01-25T00:18:18.528ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 110.982608ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
32522025-01-25T00:18:18.536ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 119.192921ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32532025-01-25T00:18:18.537ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
32542025-01-25T00:18:18.537ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
32552025-01-25T00:18:18.537ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.247726ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
32562025-01-25T00:18:18.538ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32572025-01-25T00:18:18.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32582025-01-25T00:18:18.546ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32592025-01-25T00:18:18.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32602025-01-25T00:18:18.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32612025-01-25T00:18:18.550ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32622025-01-25T00:18:18.550ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32632025-01-25T00:18:18.550ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 132.965143ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32642025-01-25T00:18:18.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32652025-01-25T00:18:18.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
32662025-01-25T00:18:18.550ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32672025-01-25T00:18:18.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32682025-01-25T00:18:18.551ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 133.370134ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32692025-01-25T00:18:18.561ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32702025-01-25T00:18:18.561ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32712025-01-25T00:18:18.561ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32722025-01-25T00:18:18.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32732025-01-25T00:18:18.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32742025-01-25T00:18:18.562ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32752025-01-25T00:18:18.562ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32762025-01-25T00:18:18.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32772025-01-25T00:18:18.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32782025-01-25T00:18:18.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32792025-01-25T00:18:18.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32802025-01-25T00:18:18.579ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
32812025-01-25T00:18:18.579ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32822025-01-25T00:18:18.579ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3891e0ae-cbc9-4880-aa71-0ea7d6c3bab7", "content-length": "26", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} })
32832025-01-25T00:18:18.579ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32842025-01-25T00:18:18.583ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
32852025-01-25T00:18:18.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 178.258368ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32862025-01-25T00:18:18.598ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
32872025-01-25T00:18:18.603ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
32882025-01-25T00:18:18.620ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32892025-01-25T00:18:18.621ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "18dbe196-5540-4f60-9262-be1297b35fbd", "content-length": "691", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} })
32902025-01-25T00:18:18.621ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32912025-01-25T00:18:18.621ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32922025-01-25T00:18:18.621ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32932025-01-25T00:18:18.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32942025-01-25T00:18:18.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32952025-01-25T00:18:18.623ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 206.358274ms iteration = 17 status = {}
32962025-01-25T00:18:18.624ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32972025-01-25T00:18:18.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32982025-01-25T00:18:18.626ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32992025-01-25T00:18:18.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33002025-01-25T00:18:18.638ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
33012025-01-25T00:18:18.638ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33022025-01-25T00:18:18.639ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e55215ee-5855-45f5-b514-97ef547751fa", "content-length": "26", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} })
33032025-01-25T00:18:18.639ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33042025-01-25T00:18:18.641ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
33052025-01-25T00:18:18.641ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 223.586405ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
33062025-01-25T00:18:18.643ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33072025-01-25T00:18:18.653ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
33082025-01-25T00:18:18.653ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33092025-01-25T00:18:18.653ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b82bde8-a7b9-4858-8479-89e3341215f8", "content-length": "26", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} })
33102025-01-25T00:18:18.653ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33112025-01-25T00:18:18.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33122025-01-25T00:18:18.654ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 237.134305ms iteration = 19 status = {"physical_disks_added":0}
33132025-01-25T00:18:18.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33142025-01-25T00:18:18.656ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33152025-01-25T00:18:18.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33162025-01-25T00:18:18.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33172025-01-25T00:18:18.659ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33182025-01-25T00:18:18.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 241.546017ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
33192025-01-25T00:18:18.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33202025-01-25T00:18:18.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33212025-01-25T00:18:18.661ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33222025-01-25T00:18:18.662ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
33232025-01-25T00:18:18.662ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 245.110957ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
33242025-01-25T00:18:18.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
33252025-01-25T00:18:18.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33262025-01-25T00:18:18.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33272025-01-25T00:18:18.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33282025-01-25T00:18:18.664ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33292025-01-25T00:18:18.664ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33302025-01-25T00:18:18.664ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 246.967526ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33312025-01-25T00:18:18.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33322025-01-25T00:18:18.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33332025-01-25T00:18:18.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33342025-01-25T00:18:18.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33352025-01-25T00:18:18.665ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 248.008261ms iteration = 17 status = 0
33362025-01-25T00:18:18.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33372025-01-25T00:18:18.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33382025-01-25T00:18:18.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33392025-01-25T00:18:18.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33402025-01-25T00:18:18.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33412025-01-25T00:18:18.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33422025-01-25T00:18:18.674ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33432025-01-25T00:18:18.674ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 0 version = 2
33442025-01-25T00:18:18.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33452025-01-25T00:18:18.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33462025-01-25T00:18:18.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33472025-01-25T00:18:18.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33482025-01-25T00:18:18.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33492025-01-25T00:18:18.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33502025-01-25T00:18:18.712ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33512025-01-25T00:18:18.712ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33522025-01-25T00:18:18.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33532025-01-25T00:18:18.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33542025-01-25T00:18:18.714ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 1 version = 2
33552025-01-25T00:18:18.714ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
33562025-01-25T00:18:18.714ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-25 00:10:47.835608 UTC dns_group = external generation = 2
33572025-01-25T00:18:18.714ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 297.131077ms iteration = 9 status = {"generation":2}
33582025-01-25T00:18:18.714ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33592025-01-25T00:18:18.715ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-25T00:10:16.530962Z, time_modified: 2025-01-25T00:10:16.530962Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }) }
33602025-01-25T00:18:18.715ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 298.037422ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]}},"default_endpoint":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
33612025-01-25T00:18:18.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33622025-01-25T00:18:18.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33632025-01-25T00:18:18.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33642025-01-25T00:18:18.720ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
33652025-01-25T00:18:18.720ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33662025-01-25T00:18:18.720ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-25 00:10:46.879674 UTC dns_group = internal generation = 1
33672025-01-25T00:18:18.720ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 303.201799ms iteration = 9 status = {"generation":1}
33682025-01-25T00:18:18.750ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
33692025-01-25T00:18:18.750ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 332.505462ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33702025-01-25T00:18:18.784ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33712025-01-25T00:18:18.784ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "74ff4434-bb2a-4f13-bc54-6e33cfb9a1bb", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33722025-01-25T00:18:18.785ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33732025-01-25T00:18:18.787ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "289ab401-bd0e-47d5-83c8-e3753dc5c570", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33742025-01-25T00:18:18.787ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33752025-01-25T00:18:18.789ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33762025-01-25T00:18:18.789ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 371.933117ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33772025-01-25T00:18:18.792ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33782025-01-25T00:18:18.792ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33792025-01-25T00:18:18.792ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e64adc36-624a-4bde-aab8-249ac68b8cf8", "content-length": "372", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} })
33802025-01-25T00:18:18.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33812025-01-25T00:18:18.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33822025-01-25T00:18:18.826ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33832025-01-25T00:18:18.826ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "718d9d68-9f86-4d82-ac7d-eaccb4fc1f1d", "content-length": "1", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} })
33842025-01-25T00:18:18.830ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33852025-01-25T00:18:18.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33862025-01-25T00:18:18.833ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 415.844005ms iteration = 17 status = null
33872025-01-25T00:18:18.869ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
33882025-01-25T00:18:18.869ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33892025-01-25T00:18:18.869ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f57310b3-5fb2-4e12-a4d6-b84377019c00", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} })
33902025-01-25T00:18:18.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33912025-01-25T00:18:18.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33922025-01-25T00:18:18.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33932025-01-25T00:18:18.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33942025-01-25T00:18:18.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33952025-01-25T00:18:18.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33962025-01-25T00:18:18.883ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33972025-01-25T00:18:18.883ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33982025-01-25T00:18:18.883ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c810e38b-1cac-4f12-ab85-ae9d95cb6506", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} })
33992025-01-25T00:18:18.885ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 467.494594ms iteration = 17 status = {}
34002025-01-25T00:18:18.956ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34012025-01-25T00:18:18.977ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 560.038145ms iteration = 17 status = {}
34022025-01-25T00:18:19.093ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34032025-01-25T00:18:19.094ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "20656266-95b4-43cb-a90c-8e8eb1af47bb", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34042025-01-25T00:18:19.094ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34052025-01-25T00:18:19.095ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0dee43ee-e548-4937-9372-e3ad1b839b42", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34062025-01-25T00:18:19.095ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34072025-01-25T00:18:19.097ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "916b97e5-d2d5-40d0-a835-5deed3f05ba9", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34082025-01-25T00:18:19.097ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34092025-01-25T00:18:19.099ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
34102025-01-25T00:18:19.099ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 682.177702ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
34112025-01-25T00:18:19.122ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34122025-01-25T00:18:19.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34132025-01-25T00:18:19.124ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
34142025-01-25T00:18:19.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34152025-01-25T00:18:19.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34162025-01-25T00:18:19.135ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34172025-01-25T00:18:19.135ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e30d5096-1d12-4436-9ce3-3fc95a8d38ee", "content-length": "134", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} })
34182025-01-25T00:18:19.135ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34192025-01-25T00:18:19.135ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
34202025-01-25T00:18:19.136ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34212025-01-25T00:18:19.136ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34222025-01-25T00:18:19.136ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34232025-01-25T00:18:19.136ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34242025-01-25T00:18:19.136ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34252025-01-25T00:18:19.136ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34262025-01-25T00:18:19.136ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34272025-01-25T00:18:19.136ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34282025-01-25T00:18:19.136ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
34292025-01-25T00:18:19.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34302025-01-25T00:18:19.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34312025-01-25T00:18:19.139ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34322025-01-25T00:18:19.139ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "135ce367-2b7d-4678-9da3-cecb2b099ea8", "content-length": "2", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} })
34332025-01-25T00:18:19.139ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34342025-01-25T00:18:19.140ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "524bc215-939e-4fa1-aac9-d1594566d9d7", "content-length": "52", "date": "Sat, 25 Jan 2025 00:18:18 GMT"} })
34352025-01-25T00:18:19.140ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
34362025-01-25T00:18:19.140ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34372025-01-25T00:18:19.270ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f3b32842-e5e8-4837-a1b2-773443b5d338", "date": "Sat, 25 Jan 2025 00:18:19 GMT"} })
34382025-01-25T00:18:19.270ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
34392025-01-25T00:18:19.270ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
34402025-01-25T00:18:19.271ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f50ad21a-eca6-428d-ae2d-ae8026f103ef", "content-length": "682", "date": "Sat, 25 Jan 2025 00:18:19 GMT"} })
34412025-01-25T00:18:19.271ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34422025-01-25T00:18:19.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34432025-01-25T00:18:19.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34442025-01-25T00:18:19.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34452025-01-25T00:18:19.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34462025-01-25T00:18:19.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34472025-01-25T00:18:19.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34482025-01-25T00:18:19.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34492025-01-25T00:18:19.289ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 871.94194ms iteration = 17 status = {}
34502025-01-25T00:18:19.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fbd2fd23-993a-4812-a3b1-7fdda3d175cb roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34512025-01-25T00:18:19.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fbd2fd23-993a-4812-a3b1-7fdda3d175cb resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34522025-01-25T00:18:19.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fbd2fd23-993a-4812-a3b1-7fdda3d175cb response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34532025-01-25T00:18:19.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 38efec03-8ad9-4385-8554-ef7739665ab2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
34542025-01-25T00:18:19.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 38efec03-8ad9-4385-8554-ef7739665ab2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
34552025-01-25T00:18:19.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 38efec03-8ad9-4385-8554-ef7739665ab2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
34562025-01-25T00:18:20.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99a3c4c3-afe1-4042-ac58-fdbe797a7918 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34572025-01-25T00:18:20.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99a3c4c3-afe1-4042-ac58-fdbe797a7918 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34582025-01-25T00:18:20.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99a3c4c3-afe1-4042-ac58-fdbe797a7918 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34592025-01-25T00:18:20.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 480 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 883b217a-1821-4fb1-8f9e-51d60d8d9fc4 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
34602025-01-25T00:18:21.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 797a7109-abd0-48e9-bc5c-c6c38a8aa0ba roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34612025-01-25T00:18:21.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 797a7109-abd0-48e9-bc5c-c6c38a8aa0ba resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34622025-01-25T00:18:21.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 797a7109-abd0-48e9-bc5c-c6c38a8aa0ba response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34632025-01-25T00:18:22.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 51d7b867-df9a-4a5e-9e00-3107ab16b438 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34642025-01-25T00:18:22.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 51d7b867-df9a-4a5e-9e00-3107ab16b438 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34652025-01-25T00:18:22.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 51d7b867-df9a-4a5e-9e00-3107ab16b438 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34662025-01-25T00:18:23.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f0481f1d-b88f-4ef1-a8a5-787f84974b96 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34672025-01-25T00:18:23.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f0481f1d-b88f-4ef1-a8a5-787f84974b96 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34682025-01-25T00:18:23.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f0481f1d-b88f-4ef1-a8a5-787f84974b96 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34692025-01-25T00:18:24.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7ff801fb-50c8-434f-9587-461b0baab5ac roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34702025-01-25T00:18:24.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7ff801fb-50c8-434f-9587-461b0baab5ac resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34712025-01-25T00:18:24.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7ff801fb-50c8-434f-9587-461b0baab5ac response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34722025-01-25T00:18:25.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3aa6855e-be08-40ad-aeda-8c51c613f2db roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34732025-01-25T00:18:25.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3aa6855e-be08-40ad-aeda-8c51c613f2db resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34742025-01-25T00:18:25.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3aa6855e-be08-40ad-aeda-8c51c613f2db response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34752025-01-25T00:18:26.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2ed7eda5-a74a-4001-925b-8c1e71d7d4c7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34762025-01-25T00:18:26.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2ed7eda5-a74a-4001-925b-8c1e71d7d4c7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34772025-01-25T00:18:26.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2ed7eda5-a74a-4001-925b-8c1e71d7d4c7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34782025-01-25T00:18:27.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2bfdbd22-c589-4de4-a56b-7ec4e67edb41 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34792025-01-25T00:18:27.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2bfdbd22-c589-4de4-a56b-7ec4e67edb41 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34802025-01-25T00:18:27.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2bfdbd22-c589-4de4-a56b-7ec4e67edb41 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
34812025-01-25T00:18:28.417ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
34822025-01-25T00:18:28.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34832025-01-25T00:18:28.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34842025-01-25T00:18:28.417ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
34852025-01-25T00:18:28.417ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34862025-01-25T00:18:28.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34872025-01-25T00:18:28.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34882025-01-25T00:18:28.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34892025-01-25T00:18:28.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34902025-01-25T00:18:28.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34912025-01-25T00:18:28.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34922025-01-25T00:18:28.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34932025-01-25T00:18:28.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34942025-01-25T00:18:28.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
34952025-01-25T00:18:28.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34962025-01-25T00:18:28.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34972025-01-25T00:18:28.436ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
34982025-01-25T00:18:28.436ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.982699ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
34992025-01-25T00:18:28.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35002025-01-25T00:18:28.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35012025-01-25T00:18:28.478ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.805467ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35022025-01-25T00:18:28.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d06cd1ff-0c5c-4121-a517-31fb4d81dd13 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35032025-01-25T00:18:28.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d06cd1ff-0c5c-4121-a517-31fb4d81dd13 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35042025-01-25T00:18:28.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d06cd1ff-0c5c-4121-a517-31fb4d81dd13 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35052025-01-25T00:18:29.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 305f50d0-2c4e-49a0-b731-da09198cb53d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35062025-01-25T00:18:29.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 305f50d0-2c4e-49a0-b731-da09198cb53d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35072025-01-25T00:18:29.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 305f50d0-2c4e-49a0-b731-da09198cb53d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35082025-01-25T00:18:30.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ed876331-cb04-4d95-b2ba-68b57ff750a7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35092025-01-25T00:18:30.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ed876331-cb04-4d95-b2ba-68b57ff750a7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35102025-01-25T00:18:30.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ed876331-cb04-4d95-b2ba-68b57ff750a7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35112025-01-25T00:18:30.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 465 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 9af5d4d4-708a-4094-b98c-814f1fe50a24 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
35122025-01-25T00:18:31.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4affc31d-f23c-4102-8a84-c661453f262f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35132025-01-25T00:18:31.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4affc31d-f23c-4102-8a84-c661453f262f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35142025-01-25T00:18:31.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4affc31d-f23c-4102-8a84-c661453f262f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35152025-01-25T00:18:32.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = db3e683a-cf79-4cfb-bfcf-e7580023e473 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35162025-01-25T00:18:32.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = db3e683a-cf79-4cfb-bfcf-e7580023e473 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35172025-01-25T00:18:32.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = db3e683a-cf79-4cfb-bfcf-e7580023e473 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35182025-01-25T00:18:33.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 387dfeb6-44f9-4197-8f4f-7011bbcbf17e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35192025-01-25T00:18:33.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 387dfeb6-44f9-4197-8f4f-7011bbcbf17e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35202025-01-25T00:18:33.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 387dfeb6-44f9-4197-8f4f-7011bbcbf17e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35212025-01-25T00:18:34.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8aeae7fa-8822-4903-b0da-08f1007ce769 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35222025-01-25T00:18:34.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8aeae7fa-8822-4903-b0da-08f1007ce769 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35232025-01-25T00:18:34.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8aeae7fa-8822-4903-b0da-08f1007ce769 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35242025-01-25T00:18:35.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d69c5cea-0f6c-4f86-a232-b0124b417595 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35252025-01-25T00:18:35.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d69c5cea-0f6c-4f86-a232-b0124b417595 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35262025-01-25T00:18:35.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d69c5cea-0f6c-4f86-a232-b0124b417595 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35272025-01-25T00:18:36.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4bd47404-4162-43ee-bad3-fcb3baed62df roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35282025-01-25T00:18:36.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4bd47404-4162-43ee-bad3-fcb3baed62df resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35292025-01-25T00:18:36.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4bd47404-4162-43ee-bad3-fcb3baed62df response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35302025-01-25T00:18:37.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd7e0412-c1ea-4b0e-9bd9-37a2f99a2b32 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35312025-01-25T00:18:37.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd7e0412-c1ea-4b0e-9bd9-37a2f99a2b32 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35322025-01-25T00:18:37.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd7e0412-c1ea-4b0e-9bd9-37a2f99a2b32 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35332025-01-25T00:18:38.417ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
35342025-01-25T00:18:38.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35352025-01-25T00:18:38.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35362025-01-25T00:18:38.418ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
35372025-01-25T00:18:38.418ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35382025-01-25T00:18:38.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35392025-01-25T00:18:38.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35402025-01-25T00:18:38.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35412025-01-25T00:18:38.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35422025-01-25T00:18:38.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35432025-01-25T00:18:38.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35442025-01-25T00:18:38.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35452025-01-25T00:18:38.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.576454ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35462025-01-25T00:18:38.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35472025-01-25T00:18:38.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35482025-01-25T00:18:38.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35492025-01-25T00:18:38.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
35502025-01-25T00:18:38.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35512025-01-25T00:18:38.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35522025-01-25T00:18:38.442ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
35532025-01-25T00:18:38.443ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.139021ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
35542025-01-25T00:18:38.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a9528a51-6ba6-4dc7-abc8-6278efad0516 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35552025-01-25T00:18:38.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a9528a51-6ba6-4dc7-abc8-6278efad0516 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35562025-01-25T00:18:38.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a9528a51-6ba6-4dc7-abc8-6278efad0516 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35572025-01-25T00:18:39.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a38ac3eb-4eff-40e4-bd1d-ad38e090c093 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35582025-01-25T00:18:39.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a38ac3eb-4eff-40e4-bd1d-ad38e090c093 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35592025-01-25T00:18:39.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a38ac3eb-4eff-40e4-bd1d-ad38e090c093 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35602025-01-25T00:18:40.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 745 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 4e8fc6c4-fe75-4fdd-abe1-9ae3230ef7e5 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
35612025-01-25T00:18:40.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d97f286d-e651-4aa5-a00e-044efead5f52 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35622025-01-25T00:18:40.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d97f286d-e651-4aa5-a00e-044efead5f52 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35632025-01-25T00:18:40.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d97f286d-e651-4aa5-a00e-044efead5f52 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35642025-01-25T00:18:42.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b61ad74c-3e4d-40de-bfe4-82cfa6f5a374 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35652025-01-25T00:18:42.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b61ad74c-3e4d-40de-bfe4-82cfa6f5a374 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35662025-01-25T00:18:42.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b61ad74c-3e4d-40de-bfe4-82cfa6f5a374 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35672025-01-25T00:18:43.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9eabbb2d-946d-4a20-ab62-5a0fa35d3f4e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35682025-01-25T00:18:43.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9eabbb2d-946d-4a20-ab62-5a0fa35d3f4e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35692025-01-25T00:18:43.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9eabbb2d-946d-4a20-ab62-5a0fa35d3f4e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35702025-01-25T00:18:44.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 34dba8bf-d573-44d4-9e1b-64ac4f890380 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35712025-01-25T00:18:44.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 34dba8bf-d573-44d4-9e1b-64ac4f890380 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35722025-01-25T00:18:44.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 34dba8bf-d573-44d4-9e1b-64ac4f890380 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35732025-01-25T00:18:45.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8ce5d2cc-760b-4e31-967c-df2b206871ec roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35742025-01-25T00:18:45.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8ce5d2cc-760b-4e31-967c-df2b206871ec resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35752025-01-25T00:18:45.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8ce5d2cc-760b-4e31-967c-df2b206871ec response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35762025-01-25T00:18:45.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 73c5ded2-49dd-442f-b547-115f06fa6c2d roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
35772025-01-25T00:18:45.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 73c5ded2-49dd-442f-b547-115f06fa6c2d resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
35782025-01-25T00:18:45.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 73c5ded2-49dd-442f-b547-115f06fa6c2d response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
35792025-01-25T00:18:45.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 9a6a756f-667f-4bee-b7b3-fbc9660b575b roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
35802025-01-25T00:18:45.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 9a6a756f-667f-4bee-b7b3-fbc9660b575b resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
35812025-01-25T00:18:45.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 9a6a756f-667f-4bee-b7b3-fbc9660b575b response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
35822025-01-25T00:18:46.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c73d6f6-5d12-4ca4-a0f5-b43d0176c897 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35832025-01-25T00:18:46.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c73d6f6-5d12-4ca4-a0f5-b43d0176c897 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35842025-01-25T00:18:46.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3c73d6f6-5d12-4ca4-a0f5-b43d0176c897 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35852025-01-25T00:18:47.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7f2a6187-bc8a-4003-8d2f-50434a6b064c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35862025-01-25T00:18:47.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7f2a6187-bc8a-4003-8d2f-50434a6b064c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35872025-01-25T00:18:47.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7f2a6187-bc8a-4003-8d2f-50434a6b064c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35882025-01-25T00:18:48.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 59c2a776-da61-4f66-ba14-b93c8c3d25fe roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35892025-01-25T00:18:48.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 59c2a776-da61-4f66-ba14-b93c8c3d25fe resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35902025-01-25T00:18:48.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 59c2a776-da61-4f66-ba14-b93c8c3d25fe response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
35912025-01-25T00:18:48.417ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
35922025-01-25T00:18:48.417ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
35932025-01-25T00:18:48.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35942025-01-25T00:18:48.417ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35952025-01-25T00:18:48.417ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
35962025-01-25T00:18:48.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35972025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
35982025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35992025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
36002025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36012025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
36022025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36032025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
36042025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36052025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
36062025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36072025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
36082025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
36092025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36102025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36112025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36122025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36132025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36142025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36152025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36162025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36172025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36182025-01-25T00:18:48.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36192025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
36202025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
36212025-01-25T00:18:48.419ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36222025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36232025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36242025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
36252025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36262025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36272025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
36282025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36292025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
36302025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36312025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
36322025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36332025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
36342025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36352025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
36362025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36372025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36382025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36392025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36402025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36412025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36422025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36432025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36442025-01-25T00:18:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36452025-01-25T00:18:48.421ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1451, tv_nsec: 143439132 } })
36462025-01-25T00:18:48.421ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
36472025-01-25T00:18:48.421ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1451, tv_nsec: 144186036 } })
36482025-01-25T00:18:48.422ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.96406ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36492025-01-25T00:18:48.422ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
36502025-01-25T00:18:48.424ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36512025-01-25T00:18:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
36522025-01-25T00:18:48.427ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36532025-01-25T00:18:48.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36542025-01-25T00:18:48.429ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36552025-01-25T00:18:48.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36562025-01-25T00:18:48.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36572025-01-25T00:18:48.482ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36582025-01-25T00:18:48.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36592025-01-25T00:18:48.482ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36602025-01-25T00:18:48.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36612025-01-25T00:18:48.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36622025-01-25T00:18:48.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36632025-01-25T00:18:48.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36642025-01-25T00:18:48.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.421361ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36652025-01-25T00:18:48.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36662025-01-25T00:18:48.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36672025-01-25T00:18:48.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36682025-01-25T00:18:48.486ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36692025-01-25T00:18:48.486ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36702025-01-25T00:18:48.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36712025-01-25T00:18:48.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36722025-01-25T00:18:48.487ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36732025-01-25T00:18:48.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36742025-01-25T00:18:48.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36752025-01-25T00:18:48.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36762025-01-25T00:18:48.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36772025-01-25T00:18:48.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36782025-01-25T00:18:48.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36792025-01-25T00:18:48.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36802025-01-25T00:18:48.488ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.376501ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
36812025-01-25T00:18:48.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36822025-01-25T00:18:48.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36832025-01-25T00:18:48.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36842025-01-25T00:18:48.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.326936ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
36852025-01-25T00:18:48.489ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36862025-01-25T00:18:48.489ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36872025-01-25T00:18:48.489ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36882025-01-25T00:18:48.489ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36892025-01-25T00:18:48.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36902025-01-25T00:18:48.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36912025-01-25T00:18:48.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36922025-01-25T00:18:48.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36932025-01-25T00:18:48.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36942025-01-25T00:18:48.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36952025-01-25T00:18:48.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36962025-01-25T00:18:48.496ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36972025-01-25T00:18:48.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36982025-01-25T00:18:48.498ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1451, tv_nsec: 220441163 } })
36992025-01-25T00:18:48.498ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
37002025-01-25T00:18:48.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37012025-01-25T00:18:48.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37022025-01-25T00:18:48.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
37032025-01-25T00:18:48.499ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37042025-01-25T00:18:48.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37052025-01-25T00:18:48.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37062025-01-25T00:18:48.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37072025-01-25T00:18:48.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37082025-01-25T00:18:48.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37092025-01-25T00:18:48.503ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37102025-01-25T00:18:48.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37112025-01-25T00:18:48.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37122025-01-25T00:18:48.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
37132025-01-25T00:18:48.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37142025-01-25T00:18:48.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37152025-01-25T00:18:48.510ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
37162025-01-25T00:18:48.510ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37172025-01-25T00:18:48.511ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "527f07db-9813-412e-aed8-9cffd5abf501", "content-length": "26", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
37182025-01-25T00:18:48.511ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37192025-01-25T00:18:48.513ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37202025-01-25T00:18:48.528ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
37212025-01-25T00:18:48.528ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37222025-01-25T00:18:48.528ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6c9d32e-ace2-419e-b3f3-bbff7e782eb3", "content-length": "26", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
37232025-01-25T00:18:48.528ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37242025-01-25T00:18:48.531ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37252025-01-25T00:18:48.536ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
37262025-01-25T00:18:48.536ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 118.117425ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
37272025-01-25T00:18:48.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37282025-01-25T00:18:48.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37292025-01-25T00:18:48.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 119.399602ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37302025-01-25T00:18:48.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 121.111661ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37312025-01-25T00:18:48.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37322025-01-25T00:18:48.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37332025-01-25T00:18:48.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37342025-01-25T00:18:48.544ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37352025-01-25T00:18:48.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
37362025-01-25T00:18:48.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37372025-01-25T00:18:48.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37382025-01-25T00:18:48.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37392025-01-25T00:18:48.545ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37402025-01-25T00:18:48.545ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37412025-01-25T00:18:48.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37422025-01-25T00:18:48.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37432025-01-25T00:18:48.546ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37442025-01-25T00:18:48.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37452025-01-25T00:18:48.547ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 129.213433ms iteration = 18 status = 0
37462025-01-25T00:18:48.549ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37472025-01-25T00:18:48.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37482025-01-25T00:18:48.552ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37492025-01-25T00:18:48.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37502025-01-25T00:18:48.554ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37512025-01-25T00:18:48.554ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 135.530406ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37522025-01-25T00:18:48.555ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
37532025-01-25T00:18:48.555ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 137.858107ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
37542025-01-25T00:18:48.561ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 143.381987ms iteration = 20 status = {"physical_disks_added":0}
37552025-01-25T00:18:48.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 160.844418ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
37562025-01-25T00:18:48.585ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37572025-01-25T00:18:48.585ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3afdc520-b0de-4367-8139-85a3b4e3e1af", "content-length": "1", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
37582025-01-25T00:18:48.586ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37592025-01-25T00:18:48.586ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37602025-01-25T00:18:48.586ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 167.463012ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37612025-01-25T00:18:48.587ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37622025-01-25T00:18:48.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37632025-01-25T00:18:48.589ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 171.440843ms iteration = 18 status = null
37642025-01-25T00:18:48.635ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
37652025-01-25T00:18:48.635ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37662025-01-25T00:18:48.636ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd2051a8-f692-4072-93c6-83be480345d4", "content-length": "26", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
37672025-01-25T00:18:48.636ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37682025-01-25T00:18:48.637ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
37692025-01-25T00:18:48.650ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37702025-01-25T00:18:48.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37712025-01-25T00:18:48.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37722025-01-25T00:18:48.654ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37732025-01-25T00:18:48.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37742025-01-25T00:18:48.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37752025-01-25T00:18:48.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37762025-01-25T00:18:48.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37772025-01-25T00:18:48.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37782025-01-25T00:18:48.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37792025-01-25T00:18:48.681ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37802025-01-25T00:18:48.681ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37812025-01-25T00:18:48.682ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "07769e8a-66f1-48ed-a0ff-d0c79666e237", "content-length": "372", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
37822025-01-25T00:18:48.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37832025-01-25T00:18:48.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37842025-01-25T00:18:48.687ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 269.735775ms iteration = 18 status = {}
37852025-01-25T00:18:48.723ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37862025-01-25T00:18:48.723ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37872025-01-25T00:18:48.723ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e5054524-d783-485b-a5d2-9705367fc311", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
37882025-01-25T00:18:48.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37892025-01-25T00:18:48.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37902025-01-25T00:18:48.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37912025-01-25T00:18:48.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37922025-01-25T00:18:48.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37932025-01-25T00:18:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37942025-01-25T00:18:48.738ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37952025-01-25T00:18:48.738ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37962025-01-25T00:18:48.739ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fd6b7721-834f-4182-927a-e601cc06c0a3", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
37972025-01-25T00:18:48.740ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 321.388994ms iteration = 18 status = {}
37982025-01-25T00:18:48.751ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37992025-01-25T00:18:48.751ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3a4d4e3-5d13-44b9-a20b-a17fff7c5129", "content-length": "691", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
38002025-01-25T00:18:48.751ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
38012025-01-25T00:18:48.751ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
38022025-01-25T00:18:48.751ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
38032025-01-25T00:18:48.753ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 335.097385ms iteration = 18 status = {}
38042025-01-25T00:18:48.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38052025-01-25T00:18:48.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38062025-01-25T00:18:48.799ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
38072025-01-25T00:18:48.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38082025-01-25T00:18:48.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38092025-01-25T00:18:48.810ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38102025-01-25T00:18:48.810ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b182e531-f2dd-4059-8e16-33e5fde3664b", "content-length": "134", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
38112025-01-25T00:18:48.810ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38122025-01-25T00:18:48.810ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
38132025-01-25T00:18:48.811ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38142025-01-25T00:18:48.811ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38152025-01-25T00:18:48.811ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38162025-01-25T00:18:48.811ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38172025-01-25T00:18:48.811ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38182025-01-25T00:18:48.811ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38192025-01-25T00:18:48.811ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38202025-01-25T00:18:48.811ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38212025-01-25T00:18:48.811ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
38222025-01-25T00:18:48.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38232025-01-25T00:18:48.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38242025-01-25T00:18:48.813ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38252025-01-25T00:18:48.813ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f95fa9b6-45a9-4da9-ae21-e28f328798e0", "content-length": "2", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
38262025-01-25T00:18:48.813ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38272025-01-25T00:18:48.814ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b9d517b-b09e-4557-804b-be8ea162f365", "content-length": "52", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
38282025-01-25T00:18:48.814ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
38292025-01-25T00:18:48.814ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38302025-01-25T00:18:49.030ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "49d45cd9-e21d-4740-930c-daf65e627e1f", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
38312025-01-25T00:18:49.030ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
38322025-01-25T00:18:49.030ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38332025-01-25T00:18:49.030ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "306156a9-300e-406b-bf3d-88f00abb10ea", "content-length": "682", "date": "Sat, 25 Jan 2025 00:18:48 GMT"} })
38342025-01-25T00:18:49.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38352025-01-25T00:18:49.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38362025-01-25T00:18:49.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38372025-01-25T00:18:49.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38382025-01-25T00:18:49.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38392025-01-25T00:18:49.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38402025-01-25T00:18:49.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38412025-01-25T00:18:49.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38422025-01-25T00:18:49.050ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 632.365222ms iteration = 18 status = {}
38432025-01-25T00:18:49.222ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
38442025-01-25T00:18:49.222ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
38452025-01-25T00:18:49.254ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
38462025-01-25T00:18:49.254ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:48329
38472025-01-25T00:18:49.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e5bd87cc-8b31-43d0-a133-0b6b6c744fda roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38482025-01-25T00:18:49.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48329 req_id = 5765e604-e5aa-4db3-aa16-6aaa3e7bebce roles = RoleSet { roles: {} } uri = /metrics/producers
38492025-01-25T00:18:49.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e5bd87cc-8b31-43d0-a133-0b6b6c744fda resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38502025-01-25T00:18:49.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48329 req_id = 5765e604-e5aa-4db3-aa16-6aaa3e7bebce resource = Database result = Ok(()) uri = /metrics/producers
38512025-01-25T00:18:49.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e5bd87cc-8b31-43d0-a133-0b6b6c744fda response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38522025-01-25T00:18:49.296ZINFOnexus: assigned collector to new producer collector_id = 512ae8cc-0c00-4148-bad7-ae5dd7be4169 file = nexus/src/app/oximeter.rs:76 producer_id = af353237-4651-4023-8604-ee309f64048e
38532025-01-25T00:18:49.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41848 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48329 req_id = 5765e604-e5aa-4db3-aa16-6aaa3e7bebce response_code = 201 uri = /metrics/producers
38542025-01-25T00:18:49.296ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "5765e604-e5aa-4db3-aa16-6aaa3e7bebce", "content-length": "41", "date": "Sat, 25 Jan 2025 00:18:49 GMT"} })
38552025-01-25T00:18:49.298ZDEBGnexus (producer-registration-task): registered with nexus successfully
38562025-01-25T00:18:49.298ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
38572025-01-25T00:18:49.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = fdcec2dc-f876-4a06-835c-9c847bd68359 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
38582025-01-25T00:18:49.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = fdcec2dc-f876-4a06-835c-9c847bd68359 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
38592025-01-25T00:18:49.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = fdcec2dc-f876-4a06-835c-9c847bd68359 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
38602025-01-25T00:18:50.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 282cb2ee-6e2d-46b8-b4c5-49d2882d3846 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38612025-01-25T00:18:50.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 282cb2ee-6e2d-46b8-b4c5-49d2882d3846 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38622025-01-25T00:18:50.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 282cb2ee-6e2d-46b8-b4c5-49d2882d3846 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38632025-01-25T00:18:50.981ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 584 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 1bd3e646-d2cb-42f4-9797-3a2aaa45ce4f response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
38642025-01-25T00:18:51.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 586a435b-1306-4363-a307-73c8aad48753 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38652025-01-25T00:18:51.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 586a435b-1306-4363-a307-73c8aad48753 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38662025-01-25T00:18:51.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 586a435b-1306-4363-a307-73c8aad48753 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38672025-01-25T00:18:52.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 263320c1-a2ce-459c-9b0d-2f0c98cbcfcf roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38682025-01-25T00:18:52.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 263320c1-a2ce-459c-9b0d-2f0c98cbcfcf resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38692025-01-25T00:18:52.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 263320c1-a2ce-459c-9b0d-2f0c98cbcfcf response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38702025-01-25T00:18:53.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 568db49d-16e7-4b45-8cc2-ac1a43b75cc8 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38712025-01-25T00:18:53.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 568db49d-16e7-4b45-8cc2-ac1a43b75cc8 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38722025-01-25T00:18:53.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 568db49d-16e7-4b45-8cc2-ac1a43b75cc8 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38732025-01-25T00:18:54.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 853a8910-0a20-421e-b68b-3003f758d518 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38742025-01-25T00:18:54.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 853a8910-0a20-421e-b68b-3003f758d518 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38752025-01-25T00:18:54.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 853a8910-0a20-421e-b68b-3003f758d518 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38762025-01-25T00:18:55.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f1349f44-9d67-4b7b-bcca-8a4901b33aca roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38772025-01-25T00:18:55.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f1349f44-9d67-4b7b-bcca-8a4901b33aca resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38782025-01-25T00:18:55.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f1349f44-9d67-4b7b-bcca-8a4901b33aca response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38792025-01-25T00:18:56.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ff6cb41e-c8d8-46a4-a29b-d73f6acff71d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38802025-01-25T00:18:56.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ff6cb41e-c8d8-46a4-a29b-d73f6acff71d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38812025-01-25T00:18:56.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ff6cb41e-c8d8-46a4-a29b-d73f6acff71d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38822025-01-25T00:18:57.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 74befc70-5462-4b6d-b3c4-ee33fa19e318 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38832025-01-25T00:18:57.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 74befc70-5462-4b6d-b3c4-ee33fa19e318 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38842025-01-25T00:18:57.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 74befc70-5462-4b6d-b3c4-ee33fa19e318 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
38852025-01-25T00:18:58.417ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
38862025-01-25T00:18:58.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38872025-01-25T00:18:58.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38882025-01-25T00:18:58.418ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
38892025-01-25T00:18:58.418ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38902025-01-25T00:18:58.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38912025-01-25T00:18:58.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38922025-01-25T00:18:58.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38932025-01-25T00:18:58.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38942025-01-25T00:18:58.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.068221ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38952025-01-25T00:18:58.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38962025-01-25T00:18:58.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38972025-01-25T00:18:58.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38982025-01-25T00:18:58.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38992025-01-25T00:18:58.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39002025-01-25T00:18:58.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39012025-01-25T00:18:58.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
39022025-01-25T00:18:58.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39032025-01-25T00:18:58.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39042025-01-25T00:18:58.443ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
39052025-01-25T00:18:58.443ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.829804ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
39062025-01-25T00:18:58.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69da0819-e66c-46f5-a03b-82dcd2ba608e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39072025-01-25T00:18:58.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69da0819-e66c-46f5-a03b-82dcd2ba608e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39082025-01-25T00:18:58.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 69da0819-e66c-46f5-a03b-82dcd2ba608e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39092025-01-25T00:18:59.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 23ab9c17-de80-4510-a6e1-0500a5856852 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39102025-01-25T00:18:59.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 23ab9c17-de80-4510-a6e1-0500a5856852 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39112025-01-25T00:18:59.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 23ab9c17-de80-4510-a6e1-0500a5856852 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39122025-01-25T00:19:00.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d602a55f-590a-4738-8537-bbcf0d123546 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39132025-01-25T00:19:00.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d602a55f-590a-4738-8537-bbcf0d123546 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39142025-01-25T00:19:00.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d602a55f-590a-4738-8537-bbcf0d123546 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39152025-01-25T00:19:00.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 539 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = ec56b303-bbbb-4af3-ba0b-ce3600b853ff response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
39162025-01-25T00:19:01.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 76fc2996-15e8-4a37-bfe0-dabb2c0ab4d3 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39172025-01-25T00:19:01.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 76fc2996-15e8-4a37-bfe0-dabb2c0ab4d3 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39182025-01-25T00:19:01.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 76fc2996-15e8-4a37-bfe0-dabb2c0ab4d3 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39192025-01-25T00:19:02.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a42d78f6-a551-47d4-9f97-e2093ce43296 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39202025-01-25T00:19:02.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a42d78f6-a551-47d4-9f97-e2093ce43296 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39212025-01-25T00:19:02.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2623 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a42d78f6-a551-47d4-9f97-e2093ce43296 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39222025-01-25T00:19:03.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 52931293-8e7b-4742-a325-13693fd61553 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39232025-01-25T00:19:03.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 52931293-8e7b-4742-a325-13693fd61553 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39242025-01-25T00:19:03.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 52931293-8e7b-4742-a325-13693fd61553 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39252025-01-25T00:19:04.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c21b953b-7aa6-43d1-b5ff-d5b751549779 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39262025-01-25T00:19:04.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c21b953b-7aa6-43d1-b5ff-d5b751549779 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39272025-01-25T00:19:04.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c21b953b-7aa6-43d1-b5ff-d5b751549779 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39282025-01-25T00:19:05.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = aa3702f5-0b98-4bc8-9128-0c5e87716e09 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39292025-01-25T00:19:05.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = aa3702f5-0b98-4bc8-9128-0c5e87716e09 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39302025-01-25T00:19:05.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = aa3702f5-0b98-4bc8-9128-0c5e87716e09 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39312025-01-25T00:19:06.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b14b307-5682-4eff-834a-c30287a51719 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39322025-01-25T00:19:06.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b14b307-5682-4eff-834a-c30287a51719 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39332025-01-25T00:19:06.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b14b307-5682-4eff-834a-c30287a51719 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39342025-01-25T00:19:07.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f5fd2564-1a20-4b29-a162-a00c4e989314 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39352025-01-25T00:19:07.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f5fd2564-1a20-4b29-a162-a00c4e989314 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39362025-01-25T00:19:07.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f5fd2564-1a20-4b29-a162-a00c4e989314 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39372025-01-25T00:19:08.418ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
39382025-01-25T00:19:08.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39392025-01-25T00:19:08.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39402025-01-25T00:19:08.419ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
39412025-01-25T00:19:08.419ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39422025-01-25T00:19:08.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39432025-01-25T00:19:08.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39442025-01-25T00:19:08.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39452025-01-25T00:19:08.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39462025-01-25T00:19:08.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39472025-01-25T00:19:08.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39482025-01-25T00:19:08.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.597799ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39492025-01-25T00:19:08.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39502025-01-25T00:19:08.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39512025-01-25T00:19:08.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39522025-01-25T00:19:08.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39532025-01-25T00:19:08.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
39542025-01-25T00:19:08.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39552025-01-25T00:19:08.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39562025-01-25T00:19:08.437ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
39572025-01-25T00:19:08.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.846913ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
39582025-01-25T00:19:08.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8ec4bca9-9a68-478a-a1f9-5c7bd75f3470 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39592025-01-25T00:19:08.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8ec4bca9-9a68-478a-a1f9-5c7bd75f3470 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39602025-01-25T00:19:08.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8ec4bca9-9a68-478a-a1f9-5c7bd75f3470 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39612025-01-25T00:19:09.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 103e3a61-1b59-4f68-a9a7-6b4f5e72ad11 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39622025-01-25T00:19:09.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 103e3a61-1b59-4f68-a9a7-6b4f5e72ad11 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39632025-01-25T00:19:09.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 103e3a61-1b59-4f68-a9a7-6b4f5e72ad11 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39642025-01-25T00:19:10.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ebfbb215-8b08-41a1-8d37-dd3ad45f55ab roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39652025-01-25T00:19:10.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ebfbb215-8b08-41a1-8d37-dd3ad45f55ab resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39662025-01-25T00:19:10.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ebfbb215-8b08-41a1-8d37-dd3ad45f55ab response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39672025-01-25T00:19:10.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 536 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 58ff72cc-fb48-4b32-aec9-ec19355dd052 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
39682025-01-25T00:19:11.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 25a41e84-9479-411c-9951-01e919a9b531 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39692025-01-25T00:19:11.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 25a41e84-9479-411c-9951-01e919a9b531 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39702025-01-25T00:19:11.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 25a41e84-9479-411c-9951-01e919a9b531 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39712025-01-25T00:19:12.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fe8b781d-e4c7-4acd-af0c-1f8b1c13c125 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39722025-01-25T00:19:12.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fe8b781d-e4c7-4acd-af0c-1f8b1c13c125 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39732025-01-25T00:19:12.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fe8b781d-e4c7-4acd-af0c-1f8b1c13c125 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39742025-01-25T00:19:13.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3f6f041b-4280-45aa-b175-108b9f5c4c57 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39752025-01-25T00:19:13.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3f6f041b-4280-45aa-b175-108b9f5c4c57 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39762025-01-25T00:19:13.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3f6f041b-4280-45aa-b175-108b9f5c4c57 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39772025-01-25T00:19:14.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e6482ad0-643e-42cc-bf29-d636cca6001e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39782025-01-25T00:19:14.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e6482ad0-643e-42cc-bf29-d636cca6001e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39792025-01-25T00:19:14.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e6482ad0-643e-42cc-bf29-d636cca6001e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39802025-01-25T00:19:15.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bc049e22-c45f-459a-8232-2c8b666274ee roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39812025-01-25T00:19:15.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bc049e22-c45f-459a-8232-2c8b666274ee resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39822025-01-25T00:19:15.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bc049e22-c45f-459a-8232-2c8b666274ee response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39832025-01-25T00:19:15.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 53917548-49bd-4fcb-978b-21842672330c roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
39842025-01-25T00:19:15.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 53917548-49bd-4fcb-978b-21842672330c resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
39852025-01-25T00:19:15.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = 53917548-49bd-4fcb-978b-21842672330c response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
39862025-01-25T00:19:15.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = f9d43f99-35ad-4ac8-8bc1-4d8860db265b roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
39872025-01-25T00:19:15.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = f9d43f99-35ad-4ac8-8bc1-4d8860db265b resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
39882025-01-25T00:19:15.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:60784 req_id = f9d43f99-35ad-4ac8-8bc1-4d8860db265b response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
39892025-01-25T00:19:16.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0894825-bc3c-40ae-bb22-41c397b2ad7e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39902025-01-25T00:19:16.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0894825-bc3c-40ae-bb22-41c397b2ad7e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39912025-01-25T00:19:16.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0894825-bc3c-40ae-bb22-41c397b2ad7e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39922025-01-25T00:19:17.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 383aff8e-9077-4cb5-bce7-02fda63f5f88 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39932025-01-25T00:19:17.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 383aff8e-9077-4cb5-bce7-02fda63f5f88 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39942025-01-25T00:19:17.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 383aff8e-9077-4cb5-bce7-02fda63f5f88 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
39952025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
39962025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
39972025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39982025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
39992025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40002025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40012025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
40022025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
40032025-01-25T00:19:18.418ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2
40042025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.71\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2"}
40052025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
40062025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
40072025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
40082025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40092025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40102025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40112025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
40122025-01-25T00:19:18.418ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
40132025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40142025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
40152025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
40162025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40172025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40182025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
40192025-01-25T00:19:18.418ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-25 00:09:18.418449108 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
40202025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
40212025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
40222025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40232025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
40242025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40252025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
40262025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
40272025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
40282025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40292025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
40302025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40312025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
40322025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40332025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
40342025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40352025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
40362025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40372025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40382025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40392025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40402025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40412025-01-25T00:19:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40422025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40432025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40442025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40452025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40462025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40472025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
40482025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40492025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
40502025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
40512025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40522025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40532025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40542025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
40552025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40562025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
40572025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40582025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
40592025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40602025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
40612025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40622025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40632025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
40642025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40652025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
40662025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40672025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40682025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
40692025-01-25T00:19:18.419ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40702025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
40712025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40722025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40732025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
40742025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
40752025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40762025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40772025-01-25T00:19:18.419ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("167a4f68-f407-48e5-a9a6-22f96a22bf2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3a6aa3c-ea79-4881-9aa5-b12ba496f837.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1481, tv_nsec: 140753008 } })
40782025-01-25T00:19:18.419ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22685765-7656-499f-8835-1c19f38e16e6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1481, tv_nsec: 140767358 } })
40792025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40802025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40812025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40822025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40832025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40842025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40852025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40862025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40872025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40882025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40892025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40902025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
40912025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40922025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40932025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40942025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
40952025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.247566ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
40962025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40972025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40982025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
40992025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.335347ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
41002025-01-25T00:19:18.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41012025-01-25T00:19:18.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41022025-01-25T00:19:18.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41032025-01-25T00:19:18.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41042025-01-25T00:19:18.421ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41052025-01-25T00:19:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41062025-01-25T00:19:18.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41072025-01-25T00:19:18.422ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.058841ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41082025-01-25T00:19:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41092025-01-25T00:19:18.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41102025-01-25T00:19:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41112025-01-25T00:19:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41122025-01-25T00:19:18.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41132025-01-25T00:19:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41142025-01-25T00:19:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
41152025-01-25T00:19:18.424ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41162025-01-25T00:19:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41172025-01-25T00:19:18.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41182025-01-25T00:19:18.425ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41192025-01-25T00:19:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41202025-01-25T00:19:18.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41212025-01-25T00:19:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41222025-01-25T00:19:18.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41232025-01-25T00:19:18.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41242025-01-25T00:19:18.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41252025-01-25T00:19:18.427ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41262025-01-25T00:19:18.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41272025-01-25T00:19:18.428ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-25 00:09:18.418449108 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41282025-01-25T00:19:18.428ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.59319ms iteration = 10 status = {"expiration":"2025-01-25T00:09:18.418449108Z","pruned":[]}
41292025-01-25T00:19:18.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41302025-01-25T00:19:18.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41312025-01-25T00:19:18.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41322025-01-25T00:19:18.430ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41332025-01-25T00:19:18.431ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1481, tv_nsec: 152854231 } })
41342025-01-25T00:19:18.431ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1481, tv_nsec: 153142193 } })
41352025-01-25T00:19:18.431ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
41362025-01-25T00:19:18.431ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
41372025-01-25T00:19:18.432ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41382025-01-25T00:19:18.432ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41392025-01-25T00:19:18.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41402025-01-25T00:19:18.433ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41412025-01-25T00:19:18.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41422025-01-25T00:19:18.435ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41432025-01-25T00:19:18.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41442025-01-25T00:19:18.444ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.784165ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
41452025-01-25T00:19:18.450ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41462025-01-25T00:19:18.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41472025-01-25T00:19:18.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41482025-01-25T00:19:18.453ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41492025-01-25T00:19:18.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41502025-01-25T00:19:18.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41512025-01-25T00:19:18.456ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1481, tv_nsec: 178119333 } })
41522025-01-25T00:19:18.457ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
41532025-01-25T00:19:18.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41542025-01-25T00:19:18.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41552025-01-25T00:19:18.480ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41562025-01-25T00:19:18.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
41572025-01-25T00:19:18.486ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41582025-01-25T00:19:18.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41592025-01-25T00:19:18.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41602025-01-25T00:19:18.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41612025-01-25T00:19:18.504ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41622025-01-25T00:19:18.505ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41632025-01-25T00:19:18.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41642025-01-25T00:19:18.505ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41652025-01-25T00:19:18.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41662025-01-25T00:19:18.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41672025-01-25T00:19:18.506ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41682025-01-25T00:19:18.506ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41692025-01-25T00:19:18.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41702025-01-25T00:19:18.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41712025-01-25T00:19:18.508ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41722025-01-25T00:19:18.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41732025-01-25T00:19:18.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41742025-01-25T00:19:18.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41752025-01-25T00:19:18.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41762025-01-25T00:19:18.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41772025-01-25T00:19:18.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41782025-01-25T00:19:18.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41792025-01-25T00:19:18.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 93.194246ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
41802025-01-25T00:19:18.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41812025-01-25T00:19:18.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41822025-01-25T00:19:18.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41832025-01-25T00:19:18.513ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 94.205681ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
41842025-01-25T00:19:18.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41852025-01-25T00:19:18.513ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41862025-01-25T00:19:18.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41872025-01-25T00:19:18.514ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41882025-01-25T00:19:18.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41892025-01-25T00:19:18.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41902025-01-25T00:19:18.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41912025-01-25T00:19:18.517ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41922025-01-25T00:19:18.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41932025-01-25T00:19:18.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41942025-01-25T00:19:18.522ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41952025-01-25T00:19:18.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41962025-01-25T00:19:18.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41972025-01-25T00:19:18.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41982025-01-25T00:19:18.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
41992025-01-25T00:19:18.523ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42002025-01-25T00:19:18.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42012025-01-25T00:19:18.525ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42022025-01-25T00:19:18.526ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 107.50123ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42032025-01-25T00:19:18.526ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.987682ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42042025-01-25T00:19:18.527ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.304134ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42052025-01-25T00:19:18.528ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42062025-01-25T00:19:18.528ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42072025-01-25T00:19:18.528ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 108.849477ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42082025-01-25T00:19:18.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
42092025-01-25T00:19:18.529ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42102025-01-25T00:19:18.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42112025-01-25T00:19:18.531ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42122025-01-25T00:19:18.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42132025-01-25T00:19:18.535ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42142025-01-25T00:19:18.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42152025-01-25T00:19:18.538ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 120.634588ms iteration = 5 status = {"nsuccess":5}
42162025-01-25T00:19:18.556ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
42172025-01-25T00:19:18.556ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 137.976069ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
42182025-01-25T00:19:18.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42192025-01-25T00:19:18.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42202025-01-25T00:19:18.561ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
42212025-01-25T00:19:18.561ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
42222025-01-25T00:19:18.561ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 142.900754ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
42232025-01-25T00:19:18.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42242025-01-25T00:19:18.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42252025-01-25T00:19:18.575ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42262025-01-25T00:19:18.575ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42272025-01-25T00:19:18.575ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42282025-01-25T00:19:18.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42292025-01-25T00:19:18.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42302025-01-25T00:19:18.577ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42312025-01-25T00:19:18.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42322025-01-25T00:19:18.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42332025-01-25T00:19:18.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42342025-01-25T00:19:18.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
42352025-01-25T00:19:18.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42362025-01-25T00:19:18.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42372025-01-25T00:19:18.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42382025-01-25T00:19:18.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42392025-01-25T00:19:18.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42402025-01-25T00:19:18.585ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42412025-01-25T00:19:18.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42422025-01-25T00:19:18.586ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 167.615963ms iteration = 19 status = 0
42432025-01-25T00:19:18.587ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42442025-01-25T00:19:18.588ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42452025-01-25T00:19:18.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42462025-01-25T00:19:18.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42472025-01-25T00:19:18.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42482025-01-25T00:19:18.591ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42492025-01-25T00:19:18.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42502025-01-25T00:19:18.591ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42512025-01-25T00:19:18.591ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42522025-01-25T00:19:18.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42532025-01-25T00:19:18.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42542025-01-25T00:19:18.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
42552025-01-25T00:19:18.591ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42562025-01-25T00:19:18.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42572025-01-25T00:19:18.594ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42582025-01-25T00:19:18.594ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 175.237013ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42592025-01-25T00:19:18.602ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
42602025-01-25T00:19:18.602ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 184.543431ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
42612025-01-25T00:19:18.603ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42622025-01-25T00:19:18.603ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42632025-01-25T00:19:18.603ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42642025-01-25T00:19:18.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42652025-01-25T00:19:18.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42662025-01-25T00:19:18.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42672025-01-25T00:19:18.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42682025-01-25T00:19:18.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42692025-01-25T00:19:18.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42702025-01-25T00:19:18.614ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
42712025-01-25T00:19:18.614ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
42722025-01-25T00:19:18.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42732025-01-25T00:19:18.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42742025-01-25T00:19:18.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42752025-01-25T00:19:18.618ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42762025-01-25T00:19:18.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42772025-01-25T00:19:18.621ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42782025-01-25T00:19:18.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42792025-01-25T00:19:18.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42802025-01-25T00:19:18.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42812025-01-25T00:19:18.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42822025-01-25T00:19:18.624ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42832025-01-25T00:19:18.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42842025-01-25T00:19:18.626ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
42852025-01-25T00:19:18.626ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
42862025-01-25T00:19:18.626ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-25 00:10:46.879674 UTC dns_group = internal generation = 1
42872025-01-25T00:19:18.626ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
42882025-01-25T00:19:18.626ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 207.826472ms iteration = 10 status = {"generation":1}
42892025-01-25T00:19:18.626ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42902025-01-25T00:19:18.626ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a05ca074-7088-461d-bd50-d487aac75ee8", "content-length": "26", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} })
42912025-01-25T00:19:18.626ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42922025-01-25T00:19:18.630ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42932025-01-25T00:19:18.642ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42942025-01-25T00:19:18.642ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 0 version = 2
42952025-01-25T00:19:18.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42962025-01-25T00:19:18.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42972025-01-25T00:19:18.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42982025-01-25T00:19:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42992025-01-25T00:19:18.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43002025-01-25T00:19:18.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 229.509465ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
43012025-01-25T00:19:18.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43022025-01-25T00:19:18.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43032025-01-25T00:19:18.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43042025-01-25T00:19:18.652ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 1 version = 2
43052025-01-25T00:19:18.652ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43062025-01-25T00:19:18.652ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-25 00:10:47.835608 UTC dns_group = external generation = 2
43072025-01-25T00:19:18.652ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 233.801727ms iteration = 10 status = {"generation":2}
43082025-01-25T00:19:18.655ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
43092025-01-25T00:19:18.655ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43102025-01-25T00:19:18.655ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aba14860-be5b-426c-bc91-0c0bff410e6d", "content-length": "26", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} })
43112025-01-25T00:19:18.655ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43122025-01-25T00:19:18.656ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43132025-01-25T00:19:18.656ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43142025-01-25T00:19:18.656ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 237.138775ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43152025-01-25T00:19:18.659ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43162025-01-25T00:19:18.660ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
43172025-01-25T00:19:18.660ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43182025-01-25T00:19:18.660ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e492d30-d29f-4893-91cc-000b161a2ae5", "content-length": "26", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} })
43192025-01-25T00:19:18.660ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43202025-01-25T00:19:18.662ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
43212025-01-25T00:19:18.687ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
43222025-01-25T00:19:18.687ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-25T00:10:16.530962Z, time_modified: 2025-01-25T00:10:16.530962Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }) }
43232025-01-25T00:19:18.687ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 269.189902ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]}},"default_endpoint":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43242025-01-25T00:19:18.697ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43252025-01-25T00:19:18.710ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 292.116371ms iteration = 21 status = {"physical_disks_added":0}
43262025-01-25T00:19:18.734ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
43272025-01-25T00:19:18.734ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 315.625504ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
43282025-01-25T00:19:18.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43292025-01-25T00:19:18.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43302025-01-25T00:19:18.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43312025-01-25T00:19:18.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43322025-01-25T00:19:18.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43332025-01-25T00:19:18.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43342025-01-25T00:19:18.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43352025-01-25T00:19:18.779ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43362025-01-25T00:19:18.779ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43372025-01-25T00:19:18.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43382025-01-25T00:19:18.795ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 377.373045ms iteration = 19 status = {}
43392025-01-25T00:19:18.847ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43402025-01-25T00:19:18.848ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1034d67c-9c93-43a2-a75c-e8056cc70619", "content-length": "1", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} })
43412025-01-25T00:19:18.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43422025-01-25T00:19:18.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43432025-01-25T00:19:18.863ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43442025-01-25T00:19:18.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3617aef3-bc90-4ac0-84ea-9d6148b0e886 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
43452025-01-25T00:19:18.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3617aef3-bc90-4ac0-84ea-9d6148b0e886 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
43462025-01-25T00:19:18.964ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
43472025-01-25T00:19:18.965ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3d5f8f8c-fc7b-46a2-b527-c4643c603932", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43482025-01-25T00:19:18.965ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43492025-01-25T00:19:18.966ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0e174c29-1b42-4387-b304-a30661338e43", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43502025-01-25T00:19:18.966ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43512025-01-25T00:19:18.967ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43522025-01-25T00:19:18.967ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43532025-01-25T00:19:18.967ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a07d7876-33d2-41e2-b42c-5d494dda7987", "content-length": "372", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} })
43542025-01-25T00:19:18.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43552025-01-25T00:19:18.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43562025-01-25T00:19:18.969ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43572025-01-25T00:19:18.969ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 550.834738ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43582025-01-25T00:19:18.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3617aef3-bc90-4ac0-84ea-9d6148b0e886 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
43592025-01-25T00:19:18.971ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 552.569577ms iteration = 19 status = null
43602025-01-25T00:19:18.983ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
43612025-01-25T00:19:18.984ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7c769310-6ddf-4028-92ce-f4a8caaf5a85", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43622025-01-25T00:19:18.984ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43632025-01-25T00:19:18.986ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9db92c7e-16d8-4304-bacd-2bd403e4370b", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43642025-01-25T00:19:18.986ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43652025-01-25T00:19:18.989ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "db726e39-f528-4061-be10-67f7b6e60de9", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43662025-01-25T00:19:18.989ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43672025-01-25T00:19:18.991ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
43682025-01-25T00:19:18.991ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 573.418276ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43692025-01-25T00:19:19.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43702025-01-25T00:19:19.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43712025-01-25T00:19:19.023ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
43722025-01-25T00:19:19.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43732025-01-25T00:19:19.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43742025-01-25T00:19:19.029ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
43752025-01-25T00:19:19.029ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43762025-01-25T00:19:19.029ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1d0450a3-91ff-43e3-8153-d3c67587eb8e", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} })
43772025-01-25T00:19:19.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43782025-01-25T00:19:19.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43792025-01-25T00:19:19.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43802025-01-25T00:19:19.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43812025-01-25T00:19:19.036ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43822025-01-25T00:19:19.036ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "467a2b80-2d5a-46bc-b01f-ac12c3d11cb4", "content-length": "134", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} })
43832025-01-25T00:19:19.036ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
43842025-01-25T00:19:19.036ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
43852025-01-25T00:19:19.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43862025-01-25T00:19:19.037ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
43872025-01-25T00:19:19.037ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43882025-01-25T00:19:19.037ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43892025-01-25T00:19:19.037ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43902025-01-25T00:19:19.037ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43912025-01-25T00:19:19.037ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43922025-01-25T00:19:19.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43932025-01-25T00:19:19.037ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43942025-01-25T00:19:19.037ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43952025-01-25T00:19:19.037ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
43962025-01-25T00:19:19.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43972025-01-25T00:19:19.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43982025-01-25T00:19:19.040ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
43992025-01-25T00:19:19.040ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d88254e-88a9-43dc-addb-19d2d251fef8", "content-length": "2", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} })
44002025-01-25T00:19:19.040ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44012025-01-25T00:19:19.040ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a27bc15-e8ee-4d93-a337-03b691205b6b", "content-length": "52", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} })
44022025-01-25T00:19:19.040ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
44032025-01-25T00:19:19.040ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44042025-01-25T00:19:19.040ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44052025-01-25T00:19:19.040ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44062025-01-25T00:19:19.046ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "30a6cfb3-6360-47f1-928e-ac5cab27645d", "date": "Sat, 25 Jan 2025 00:19:19 GMT"} })
44072025-01-25T00:19:19.048ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 629.208866ms iteration = 19 status = {}
44082025-01-25T00:19:19.107ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44092025-01-25T00:19:19.109ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed438706-9faa-471a-8b08-32c08f0a539f", "content-length": "691", "date": "Sat, 25 Jan 2025 00:19:19 GMT"} })
44102025-01-25T00:19:19.109ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
44112025-01-25T00:19:19.109ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
44122025-01-25T00:19:19.109ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
44132025-01-25T00:19:19.111ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 693.172649ms iteration = 19 status = {}
44142025-01-25T00:19:19.168ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7788477e-96b3-4ee0-915f-ed0ee38902a3", "date": "Sat, 25 Jan 2025 00:19:18 GMT"} })
44152025-01-25T00:19:19.168ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
44162025-01-25T00:19:19.168ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44172025-01-25T00:19:19.168ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c20ba0f-61d1-43e7-9acc-140889671780", "content-length": "682", "date": "Sat, 25 Jan 2025 00:19:19 GMT"} })
44182025-01-25T00:19:19.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44192025-01-25T00:19:19.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44202025-01-25T00:19:19.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44212025-01-25T00:19:19.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44222025-01-25T00:19:19.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44232025-01-25T00:19:19.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44242025-01-25T00:19:19.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44252025-01-25T00:19:19.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44262025-01-25T00:19:19.192ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 773.870729ms iteration = 19 status = {}
44272025-01-25T00:19:19.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = c3a19952-9143-4ae2-921b-fdeadbfd9f27 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
44282025-01-25T00:19:19.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = c3a19952-9143-4ae2-921b-fdeadbfd9f27 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
44292025-01-25T00:19:19.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = c3a19952-9143-4ae2-921b-fdeadbfd9f27 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
44302025-01-25T00:19:19.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 846c9a8a-3bfc-4f68-838e-f7cf54c80e90 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44312025-01-25T00:19:19.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 846c9a8a-3bfc-4f68-838e-f7cf54c80e90 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44322025-01-25T00:19:20.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 846c9a8a-3bfc-4f68-838e-f7cf54c80e90 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44332025-01-25T00:19:20.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 477 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = d2268a62-e0be-4ebd-98cd-2e0dc36f74fd response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
44342025-01-25T00:19:21.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = de54b318-ca70-444e-9f87-0cdeaa139631 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44352025-01-25T00:19:21.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = de54b318-ca70-444e-9f87-0cdeaa139631 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44362025-01-25T00:19:21.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = de54b318-ca70-444e-9f87-0cdeaa139631 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44372025-01-25T00:19:22.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4f1f6bdd-51e7-4ff1-ac9d-d506ad73ac66 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44382025-01-25T00:19:22.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4f1f6bdd-51e7-4ff1-ac9d-d506ad73ac66 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44392025-01-25T00:19:22.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4f1f6bdd-51e7-4ff1-ac9d-d506ad73ac66 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44402025-01-25T00:19:23.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5a9bc2ec-b620-4dad-bc68-aafde20771df roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44412025-01-25T00:19:23.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5a9bc2ec-b620-4dad-bc68-aafde20771df resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44422025-01-25T00:19:23.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5a9bc2ec-b620-4dad-bc68-aafde20771df response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44432025-01-25T00:19:24.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5177ac72-acef-421e-85b6-35f70b144901 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44442025-01-25T00:19:24.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5177ac72-acef-421e-85b6-35f70b144901 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44452025-01-25T00:19:24.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5177ac72-acef-421e-85b6-35f70b144901 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44462025-01-25T00:19:25.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 766ea1d6-edb9-4660-9e37-d5b9ff4a2e19 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44472025-01-25T00:19:25.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 766ea1d6-edb9-4660-9e37-d5b9ff4a2e19 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44482025-01-25T00:19:25.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 766ea1d6-edb9-4660-9e37-d5b9ff4a2e19 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44492025-01-25T00:19:26.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b303343d-c121-4be0-b487-433c3f8c2816 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44502025-01-25T00:19:26.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b303343d-c121-4be0-b487-433c3f8c2816 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44512025-01-25T00:19:26.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b303343d-c121-4be0-b487-433c3f8c2816 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44522025-01-25T00:19:27.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 22bdbf8e-17ce-4a10-8086-a8698b8796f0 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44532025-01-25T00:19:27.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 22bdbf8e-17ce-4a10-8086-a8698b8796f0 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44542025-01-25T00:19:27.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 22bdbf8e-17ce-4a10-8086-a8698b8796f0 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44552025-01-25T00:19:28.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7b846704-b492-4e0f-a396-34059082cea4 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44562025-01-25T00:19:28.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7b846704-b492-4e0f-a396-34059082cea4 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44572025-01-25T00:19:28.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7b846704-b492-4e0f-a396-34059082cea4 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44582025-01-25T00:19:28.418ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
44592025-01-25T00:19:28.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44602025-01-25T00:19:28.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44612025-01-25T00:19:28.419ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
44622025-01-25T00:19:28.419ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44632025-01-25T00:19:28.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44642025-01-25T00:19:28.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44652025-01-25T00:19:28.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44662025-01-25T00:19:28.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44672025-01-25T00:19:28.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44682025-01-25T00:19:28.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44692025-01-25T00:19:28.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44702025-01-25T00:19:28.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.83115ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44712025-01-25T00:19:28.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44722025-01-25T00:19:28.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44732025-01-25T00:19:28.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44742025-01-25T00:19:28.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
44752025-01-25T00:19:28.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44762025-01-25T00:19:28.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44772025-01-25T00:19:28.438ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
44782025-01-25T00:19:28.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.588872ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
44792025-01-25T00:19:29.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 842a2c44-e84c-4ad9-9257-261c0b9c51b9 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44802025-01-25T00:19:29.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 842a2c44-e84c-4ad9-9257-261c0b9c51b9 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44812025-01-25T00:19:29.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 842a2c44-e84c-4ad9-9257-261c0b9c51b9 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44822025-01-25T00:19:30.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4090173a-9d79-409c-a0a9-49f9ca440b7d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44832025-01-25T00:19:30.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4090173a-9d79-409c-a0a9-49f9ca440b7d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44842025-01-25T00:19:30.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4090173a-9d79-409c-a0a9-49f9ca440b7d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44852025-01-25T00:19:30.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 481 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 9ac1bc7b-dc63-4cb2-b95d-b0478c198a2f response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
44862025-01-25T00:19:31.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bc4aeeed-307d-4aef-a54f-623cf8f3b86b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44872025-01-25T00:19:31.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bc4aeeed-307d-4aef-a54f-623cf8f3b86b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44882025-01-25T00:19:31.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bc4aeeed-307d-4aef-a54f-623cf8f3b86b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44892025-01-25T00:19:32.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 98547cd7-3278-4f57-9edc-0ce24699da2b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44902025-01-25T00:19:32.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 98547cd7-3278-4f57-9edc-0ce24699da2b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44912025-01-25T00:19:32.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 98547cd7-3278-4f57-9edc-0ce24699da2b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44922025-01-25T00:19:33.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6595093e-02cd-4494-9854-165d40ad23d7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44932025-01-25T00:19:33.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6595093e-02cd-4494-9854-165d40ad23d7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44942025-01-25T00:19:33.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6595093e-02cd-4494-9854-165d40ad23d7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44952025-01-25T00:19:34.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cc327b55-2407-4225-9bb0-26ea07bb00b6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44962025-01-25T00:19:34.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cc327b55-2407-4225-9bb0-26ea07bb00b6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44972025-01-25T00:19:34.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cc327b55-2407-4225-9bb0-26ea07bb00b6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44982025-01-25T00:19:35.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9c87faf0-d451-49d7-a46a-26d1048702f8 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
44992025-01-25T00:19:35.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9c87faf0-d451-49d7-a46a-26d1048702f8 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45002025-01-25T00:19:35.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9c87faf0-d451-49d7-a46a-26d1048702f8 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45012025-01-25T00:19:36.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3e0a010d-8190-4c95-81ef-5d569fcd3bba roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45022025-01-25T00:19:36.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3e0a010d-8190-4c95-81ef-5d569fcd3bba resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45032025-01-25T00:19:36.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3e0a010d-8190-4c95-81ef-5d569fcd3bba response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45042025-01-25T00:19:37.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 93c6e2ec-aa80-47c3-a03b-c2ca57ff53c2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45052025-01-25T00:19:37.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 93c6e2ec-aa80-47c3-a03b-c2ca57ff53c2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45062025-01-25T00:19:37.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 93c6e2ec-aa80-47c3-a03b-c2ca57ff53c2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45072025-01-25T00:19:38.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8db2e6db-a12d-4158-ab58-40b66814f499 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45082025-01-25T00:19:38.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8db2e6db-a12d-4158-ab58-40b66814f499 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45092025-01-25T00:19:38.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8db2e6db-a12d-4158-ab58-40b66814f499 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45102025-01-25T00:19:38.419ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
45112025-01-25T00:19:38.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45122025-01-25T00:19:38.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45132025-01-25T00:19:38.419ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
45142025-01-25T00:19:38.419ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45152025-01-25T00:19:38.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45162025-01-25T00:19:38.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45172025-01-25T00:19:38.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45182025-01-25T00:19:38.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45192025-01-25T00:19:38.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.71486ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45202025-01-25T00:19:38.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45212025-01-25T00:19:38.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45222025-01-25T00:19:38.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45232025-01-25T00:19:38.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45242025-01-25T00:19:38.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45252025-01-25T00:19:38.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45262025-01-25T00:19:38.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
45272025-01-25T00:19:38.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45282025-01-25T00:19:38.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45292025-01-25T00:19:38.436ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
45302025-01-25T00:19:38.436ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.601482ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
45312025-01-25T00:19:39.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0fe5a547-4a49-4921-a7df-f4d4eeef88c3 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45322025-01-25T00:19:39.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0fe5a547-4a49-4921-a7df-f4d4eeef88c3 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45332025-01-25T00:19:39.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0fe5a547-4a49-4921-a7df-f4d4eeef88c3 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45342025-01-25T00:19:40.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6cf9ebcf-d026-4cd5-a061-776221634d5b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45352025-01-25T00:19:40.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6cf9ebcf-d026-4cd5-a061-776221634d5b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45362025-01-25T00:19:40.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6cf9ebcf-d026-4cd5-a061-776221634d5b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45372025-01-25T00:19:40.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 619 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 2e449cec-d79f-4752-aa93-6e8cf2a1a920 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
45382025-01-25T00:19:41.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5eed4dbd-f6d0-474f-85cf-598c58ee67a6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45392025-01-25T00:19:41.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5eed4dbd-f6d0-474f-85cf-598c58ee67a6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45402025-01-25T00:19:41.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5eed4dbd-f6d0-474f-85cf-598c58ee67a6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45412025-01-25T00:19:42.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4787bef6-3483-485c-8220-76decc5a7bde roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45422025-01-25T00:19:42.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4787bef6-3483-485c-8220-76decc5a7bde resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45432025-01-25T00:19:42.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4787bef6-3483-485c-8220-76decc5a7bde response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45442025-01-25T00:19:43.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8894a293-5b2e-4514-b7a4-ac766f34ac5e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45452025-01-25T00:19:43.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8894a293-5b2e-4514-b7a4-ac766f34ac5e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45462025-01-25T00:19:43.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8894a293-5b2e-4514-b7a4-ac766f34ac5e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45472025-01-25T00:19:44.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 32517971-9e20-4795-82b5-fad1a9ede50f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45482025-01-25T00:19:44.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 32517971-9e20-4795-82b5-fad1a9ede50f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45492025-01-25T00:19:44.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 32517971-9e20-4795-82b5-fad1a9ede50f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45502025-01-25T00:19:45.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c2b81e01-153e-424d-bea3-cd38ad758fae roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45512025-01-25T00:19:45.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c2b81e01-153e-424d-bea3-cd38ad758fae resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45522025-01-25T00:19:45.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c2b81e01-153e-424d-bea3-cd38ad758fae response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45532025-01-25T00:19:46.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2de4f7e5-bcf1-48cd-969a-d050bed4980b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45542025-01-25T00:19:46.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2de4f7e5-bcf1-48cd-969a-d050bed4980b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45552025-01-25T00:19:46.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2de4f7e5-bcf1-48cd-969a-d050bed4980b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45562025-01-25T00:19:47.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 12a9a9a2-5e92-457c-ad7c-ab1f7e6dd045 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45572025-01-25T00:19:47.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 12a9a9a2-5e92-457c-ad7c-ab1f7e6dd045 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45582025-01-25T00:19:47.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 12a9a9a2-5e92-457c-ad7c-ab1f7e6dd045 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
45592025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
45602025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45612025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
45622025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
45632025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45642025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45652025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
45662025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45672025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
45682025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45692025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
45702025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45712025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
45722025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
45732025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45742025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
45752025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45762025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
45772025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45782025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45792025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45802025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45812025-01-25T00:19:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45822025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45832025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45842025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45852025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45862025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45872025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
45882025-01-25T00:19:48.420ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45892025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
45902025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45912025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45922025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
45932025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45942025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45952025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
45962025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45972025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
45982025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45992025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
46002025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46012025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
46022025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46032025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
46042025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46052025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46062025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46072025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46082025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46092025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46102025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46112025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46122025-01-25T00:19:48.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46132025-01-25T00:19:48.421ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46142025-01-25T00:19:48.422ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46152025-01-25T00:19:48.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46162025-01-25T00:19:48.423ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1511, tv_nsec: 143913334 } })
46172025-01-25T00:19:48.423ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.010291ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46182025-01-25T00:19:48.423ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
46192025-01-25T00:19:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46202025-01-25T00:19:48.424ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46212025-01-25T00:19:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46222025-01-25T00:19:48.425ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46232025-01-25T00:19:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46242025-01-25T00:19:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46252025-01-25T00:19:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46262025-01-25T00:19:48.425ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46272025-01-25T00:19:48.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46282025-01-25T00:19:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46292025-01-25T00:19:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46302025-01-25T00:19:48.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46312025-01-25T00:19:48.428ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1511, tv_nsec: 149230862 } })
46322025-01-25T00:19:48.428ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
46332025-01-25T00:19:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46342025-01-25T00:19:48.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46352025-01-25T00:19:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46362025-01-25T00:19:48.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46372025-01-25T00:19:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46382025-01-25T00:19:48.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46392025-01-25T00:19:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46402025-01-25T00:19:48.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46412025-01-25T00:19:48.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46422025-01-25T00:19:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46432025-01-25T00:19:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46442025-01-25T00:19:48.450ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46452025-01-25T00:19:48.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46462025-01-25T00:19:48.456ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46472025-01-25T00:19:48.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46482025-01-25T00:19:48.458ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46492025-01-25T00:19:48.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46502025-01-25T00:19:48.461ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
46512025-01-25T00:19:48.461ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 41.822718ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
46522025-01-25T00:19:48.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46532025-01-25T00:19:48.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46542025-01-25T00:19:48.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46552025-01-25T00:19:48.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
46562025-01-25T00:19:48.479ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46572025-01-25T00:19:48.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46582025-01-25T00:19:48.483ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
46592025-01-25T00:19:48.483ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46602025-01-25T00:19:48.484ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b8569e3-6684-46b4-a2bb-95e6d4637402", "content-length": "26", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
46612025-01-25T00:19:48.484ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46622025-01-25T00:19:48.486ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.020854ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
46632025-01-25T00:19:48.487ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46642025-01-25T00:19:48.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46652025-01-25T00:19:48.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.294602ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
46662025-01-25T00:19:48.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46672025-01-25T00:19:48.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46682025-01-25T00:19:48.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46692025-01-25T00:19:48.500ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
46702025-01-25T00:19:48.500ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46712025-01-25T00:19:48.500ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46722025-01-25T00:19:48.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46732025-01-25T00:19:48.501ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46742025-01-25T00:19:48.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46752025-01-25T00:19:48.501ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77624353-8f27-45e2-8922-401455e1cfd7", "content-length": "26", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
46762025-01-25T00:19:48.501ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46772025-01-25T00:19:48.501ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1511, tv_nsec: 222360163 } })
46782025-01-25T00:19:48.502ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
46792025-01-25T00:19:48.503ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46802025-01-25T00:19:48.503ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.834812ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46812025-01-25T00:19:48.503ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
46822025-01-25T00:19:48.503ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.090327ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
46832025-01-25T00:19:48.503ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46842025-01-25T00:19:48.503ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46852025-01-25T00:19:48.503ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46862025-01-25T00:19:48.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46872025-01-25T00:19:48.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46882025-01-25T00:19:48.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46892025-01-25T00:19:48.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.014223ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46902025-01-25T00:19:48.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46912025-01-25T00:19:48.506ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46922025-01-25T00:19:48.506ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46932025-01-25T00:19:48.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46942025-01-25T00:19:48.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46952025-01-25T00:19:48.507ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46962025-01-25T00:19:48.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46972025-01-25T00:19:48.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46982025-01-25T00:19:48.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46992025-01-25T00:19:48.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47002025-01-25T00:19:48.509ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47012025-01-25T00:19:48.509ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47022025-01-25T00:19:48.509ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 89.406815ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47032025-01-25T00:19:48.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47042025-01-25T00:19:48.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47052025-01-25T00:19:48.511ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47062025-01-25T00:19:48.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47072025-01-25T00:19:48.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47082025-01-25T00:19:48.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47092025-01-25T00:19:48.514ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47102025-01-25T00:19:48.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47112025-01-25T00:19:48.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47122025-01-25T00:19:48.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47132025-01-25T00:19:48.524ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47142025-01-25T00:19:48.524ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 103.6581ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47152025-01-25T00:19:48.526ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47162025-01-25T00:19:48.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47172025-01-25T00:19:48.526ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 107.561631ms iteration = 22 status = {"physical_disks_added":0}
47182025-01-25T00:19:48.528ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47192025-01-25T00:19:48.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
47202025-01-25T00:19:48.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47212025-01-25T00:19:48.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47222025-01-25T00:19:48.533ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 114.075384ms iteration = 20 status = 0
47232025-01-25T00:19:48.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 123.686694ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47242025-01-25T00:19:48.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.150811ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
47252025-01-25T00:19:48.568ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47262025-01-25T00:19:48.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47272025-01-25T00:19:48.594ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47282025-01-25T00:19:48.595ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "87b3ca5d-1524-4a2e-92c9-56e95f1cc4b1", "content-length": "1", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
47292025-01-25T00:19:48.597ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47302025-01-25T00:19:48.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47312025-01-25T00:19:48.601ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 182.52093ms iteration = 20 status = {}
47322025-01-25T00:19:48.610ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
47332025-01-25T00:19:48.610ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47342025-01-25T00:19:48.610ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dba5ad5-2be0-4e18-aff6-ed74dece4691", "content-length": "26", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
47352025-01-25T00:19:48.610ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47362025-01-25T00:19:48.612ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
47372025-01-25T00:19:48.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 46ec4596-7f6e-444b-9e86-1e0dfd7b15a0 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
47382025-01-25T00:19:48.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 46ec4596-7f6e-444b-9e86-1e0dfd7b15a0 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
47392025-01-25T00:19:48.657ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47402025-01-25T00:19:48.657ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47412025-01-25T00:19:48.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47422025-01-25T00:19:48.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47432025-01-25T00:19:48.658ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c9ef538-5e85-4180-8099-cccb6a10a263", "content-length": "372", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
47442025-01-25T00:19:48.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47452025-01-25T00:19:48.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47462025-01-25T00:19:48.659ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 239.911259ms iteration = 20 status = null
47472025-01-25T00:19:48.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 46ec4596-7f6e-444b-9e86-1e0dfd7b15a0 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
47482025-01-25T00:19:48.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47492025-01-25T00:19:48.662ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47502025-01-25T00:19:48.662ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47512025-01-25T00:19:48.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47522025-01-25T00:19:48.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47532025-01-25T00:19:48.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47542025-01-25T00:19:48.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47552025-01-25T00:19:48.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47562025-01-25T00:19:48.705ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
47572025-01-25T00:19:48.705ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47582025-01-25T00:19:48.706ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "012344e1-0174-4b0e-9881-f01486b8ccae", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
47592025-01-25T00:19:48.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47602025-01-25T00:19:48.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47612025-01-25T00:19:48.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47622025-01-25T00:19:48.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47632025-01-25T00:19:48.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47642025-01-25T00:19:48.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47652025-01-25T00:19:48.715ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47662025-01-25T00:19:48.715ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47672025-01-25T00:19:48.716ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6acf5639-3891-426a-94a8-7e448f6a59b7", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
47682025-01-25T00:19:48.717ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 297.264988ms iteration = 20 status = {}
47692025-01-25T00:19:48.732ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47702025-01-25T00:19:48.732ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9951002-8370-469c-8f73-bdd52dc99143", "content-length": "691", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
47712025-01-25T00:19:48.732ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
47722025-01-25T00:19:48.732ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
47732025-01-25T00:19:48.732ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
47742025-01-25T00:19:48.734ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 315.569093ms iteration = 20 status = {}
47752025-01-25T00:19:48.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47762025-01-25T00:19:48.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47772025-01-25T00:19:48.765ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
47782025-01-25T00:19:48.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47792025-01-25T00:19:48.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47802025-01-25T00:19:48.774ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47812025-01-25T00:19:48.775ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6242ddcb-5795-4334-a494-a44c712041b9", "content-length": "134", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
47822025-01-25T00:19:48.775ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
47832025-01-25T00:19:48.775ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
47842025-01-25T00:19:48.775ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
47852025-01-25T00:19:48.775ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47862025-01-25T00:19:48.775ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47872025-01-25T00:19:48.775ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47882025-01-25T00:19:48.775ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47892025-01-25T00:19:48.775ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47902025-01-25T00:19:48.775ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47912025-01-25T00:19:48.775ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47922025-01-25T00:19:48.775ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
47932025-01-25T00:19:48.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47942025-01-25T00:19:48.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47952025-01-25T00:19:48.777ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47962025-01-25T00:19:48.777ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9788e617-4c97-4ad5-8456-69e0331a5282", "content-length": "2", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
47972025-01-25T00:19:48.777ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47982025-01-25T00:19:48.777ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9921395a-bb87-4d23-a59a-c0d7154d9b03", "content-length": "52", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
47992025-01-25T00:19:48.777ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
48002025-01-25T00:19:48.777ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48012025-01-25T00:19:48.908ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f462f246-46ab-4c19-9568-b53097ba64b5", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
48022025-01-25T00:19:48.908ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
48032025-01-25T00:19:48.908ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48042025-01-25T00:19:48.908ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "50cd917c-31fe-476c-8cfe-76187ce76746", "content-length": "682", "date": "Sat, 25 Jan 2025 00:19:48 GMT"} })
48052025-01-25T00:19:48.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48062025-01-25T00:19:48.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48072025-01-25T00:19:48.913ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48082025-01-25T00:19:48.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48092025-01-25T00:19:48.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48102025-01-25T00:19:48.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48112025-01-25T00:19:48.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48122025-01-25T00:19:48.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48132025-01-25T00:19:48.926ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 507.576403ms iteration = 20 status = {}
48142025-01-25T00:19:49.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = e356092e-bace-431f-a92e-fbc357fd42ec roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
48152025-01-25T00:19:49.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = e356092e-bace-431f-a92e-fbc357fd42ec resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
48162025-01-25T00:19:49.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = e356092e-bace-431f-a92e-fbc357fd42ec response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
48172025-01-25T00:19:49.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3fde3bed-6979-4c6d-859a-694cc52c5c1a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48182025-01-25T00:19:49.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3fde3bed-6979-4c6d-859a-694cc52c5c1a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48192025-01-25T00:19:49.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3fde3bed-6979-4c6d-859a-694cc52c5c1a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48202025-01-25T00:19:50.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 31b55cdc-2be5-4545-937c-8e25331170c2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48212025-01-25T00:19:50.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 31b55cdc-2be5-4545-937c-8e25331170c2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48222025-01-25T00:19:50.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 31b55cdc-2be5-4545-937c-8e25331170c2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48232025-01-25T00:19:50.984ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 501 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 4c4966ce-819d-4da1-b615-1523f984316f response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
48242025-01-25T00:19:51.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bf89d4d6-8ec0-4417-88c5-08fc4be7df9d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48252025-01-25T00:19:51.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bf89d4d6-8ec0-4417-88c5-08fc4be7df9d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48262025-01-25T00:19:51.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bf89d4d6-8ec0-4417-88c5-08fc4be7df9d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48272025-01-25T00:19:52.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b76d2ed9-502b-496a-a609-64dd1ada610a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48282025-01-25T00:19:52.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b76d2ed9-502b-496a-a609-64dd1ada610a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48292025-01-25T00:19:52.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b76d2ed9-502b-496a-a609-64dd1ada610a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48302025-01-25T00:19:53.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8c457c9-9bcb-4c39-859e-f5735211c35d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48312025-01-25T00:19:53.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8c457c9-9bcb-4c39-859e-f5735211c35d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48322025-01-25T00:19:53.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8c457c9-9bcb-4c39-859e-f5735211c35d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48332025-01-25T00:19:54.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 52e91455-7a52-432b-a39f-d73aaac5ae6e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48342025-01-25T00:19:54.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 52e91455-7a52-432b-a39f-d73aaac5ae6e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48352025-01-25T00:19:54.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 52e91455-7a52-432b-a39f-d73aaac5ae6e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48362025-01-25T00:19:55.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 181b5e11-5644-4f11-8ed6-57a20d7e43dc roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48372025-01-25T00:19:55.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 181b5e11-5644-4f11-8ed6-57a20d7e43dc resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48382025-01-25T00:19:55.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 181b5e11-5644-4f11-8ed6-57a20d7e43dc response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48392025-01-25T00:19:56.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6734f597-4e2c-4128-91b5-9ed58e07dbc6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48402025-01-25T00:19:56.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6734f597-4e2c-4128-91b5-9ed58e07dbc6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48412025-01-25T00:19:56.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6734f597-4e2c-4128-91b5-9ed58e07dbc6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48422025-01-25T00:19:57.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b5b4ef0-25b2-4901-802e-2edd3afb71ad roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48432025-01-25T00:19:57.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b5b4ef0-25b2-4901-802e-2edd3afb71ad resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48442025-01-25T00:19:57.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b5b4ef0-25b2-4901-802e-2edd3afb71ad response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48452025-01-25T00:19:58.419ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
48462025-01-25T00:19:58.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48472025-01-25T00:19:58.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48482025-01-25T00:19:58.420ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
48492025-01-25T00:19:58.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48502025-01-25T00:19:58.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48512025-01-25T00:19:58.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48522025-01-25T00:19:58.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48532025-01-25T00:19:58.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48542025-01-25T00:19:58.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.661259ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48552025-01-25T00:19:58.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48562025-01-25T00:19:58.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48572025-01-25T00:19:58.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48582025-01-25T00:19:58.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48592025-01-25T00:19:58.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48602025-01-25T00:19:58.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48612025-01-25T00:19:58.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
48622025-01-25T00:19:58.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48632025-01-25T00:19:58.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48642025-01-25T00:19:58.442ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
48652025-01-25T00:19:58.442ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.303551ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
48662025-01-25T00:19:58.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 76b094bf-38d6-4996-bc52-48fe54f3f286 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48672025-01-25T00:19:58.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 76b094bf-38d6-4996-bc52-48fe54f3f286 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48682025-01-25T00:19:58.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 76b094bf-38d6-4996-bc52-48fe54f3f286 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48692025-01-25T00:19:59.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f7d4aa5d-ee4b-4e22-9344-b01996e8582f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48702025-01-25T00:19:59.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f7d4aa5d-ee4b-4e22-9344-b01996e8582f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48712025-01-25T00:19:59.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f7d4aa5d-ee4b-4e22-9344-b01996e8582f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48722025-01-25T00:20:00.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 72f14d67-3669-498c-9dde-7768a976d3fa roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48732025-01-25T00:20:00.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 72f14d67-3669-498c-9dde-7768a976d3fa resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48742025-01-25T00:20:00.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 72f14d67-3669-498c-9dde-7768a976d3fa response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48752025-01-25T00:20:00.984ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 521 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 3a1f6e16-ecd0-479b-b48a-c410313033bd response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
48762025-01-25T00:20:01.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1532de78-183c-4f97-b049-216e8946d3ca roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48772025-01-25T00:20:01.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1532de78-183c-4f97-b049-216e8946d3ca resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48782025-01-25T00:20:01.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1532de78-183c-4f97-b049-216e8946d3ca response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48792025-01-25T00:20:02.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e7f62751-95f6-4b45-bc53-e127978f7a15 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48802025-01-25T00:20:02.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e7f62751-95f6-4b45-bc53-e127978f7a15 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48812025-01-25T00:20:02.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e7f62751-95f6-4b45-bc53-e127978f7a15 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48822025-01-25T00:20:03.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4c19b00f-ed9e-4fdb-b38d-3ef8454755b2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48832025-01-25T00:20:03.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4c19b00f-ed9e-4fdb-b38d-3ef8454755b2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48842025-01-25T00:20:03.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4c19b00f-ed9e-4fdb-b38d-3ef8454755b2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48852025-01-25T00:20:05.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ac26c11f-d2d0-4b96-b2ae-db775428d61f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48862025-01-25T00:20:05.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ac26c11f-d2d0-4b96-b2ae-db775428d61f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48872025-01-25T00:20:05.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ac26c11f-d2d0-4b96-b2ae-db775428d61f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48882025-01-25T00:20:06.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 92dbbc19-ff9b-4e23-8c46-b41e7bebacbb roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48892025-01-25T00:20:06.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 92dbbc19-ff9b-4e23-8c46-b41e7bebacbb resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48902025-01-25T00:20:06.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 92dbbc19-ff9b-4e23-8c46-b41e7bebacbb response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48912025-01-25T00:20:07.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a02acf8-9db7-4deb-a6c1-86da36f6975b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48922025-01-25T00:20:07.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a02acf8-9db7-4deb-a6c1-86da36f6975b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48932025-01-25T00:20:07.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a02acf8-9db7-4deb-a6c1-86da36f6975b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48942025-01-25T00:20:08.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d17804ac-9c40-4571-8c0a-a4554fd9d5f4 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48952025-01-25T00:20:08.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d17804ac-9c40-4571-8c0a-a4554fd9d5f4 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48962025-01-25T00:20:08.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d17804ac-9c40-4571-8c0a-a4554fd9d5f4 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
48972025-01-25T00:20:08.420ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
48982025-01-25T00:20:08.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48992025-01-25T00:20:08.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49002025-01-25T00:20:08.420ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
49012025-01-25T00:20:08.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49022025-01-25T00:20:08.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49032025-01-25T00:20:08.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49042025-01-25T00:20:08.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49052025-01-25T00:20:08.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49062025-01-25T00:20:08.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49072025-01-25T00:20:08.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49082025-01-25T00:20:08.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49092025-01-25T00:20:08.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49102025-01-25T00:20:08.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49112025-01-25T00:20:08.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49122025-01-25T00:20:08.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
49132025-01-25T00:20:08.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49142025-01-25T00:20:08.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49152025-01-25T00:20:08.442ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
49162025-01-25T00:20:08.442ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.458727ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
49172025-01-25T00:20:08.453ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.64552ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49182025-01-25T00:20:09.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6c71b11c-7be8-45ec-bda0-2642e0cb2af4 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49192025-01-25T00:20:09.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6c71b11c-7be8-45ec-bda0-2642e0cb2af4 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49202025-01-25T00:20:09.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6c71b11c-7be8-45ec-bda0-2642e0cb2af4 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49212025-01-25T00:20:10.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a8055c5a-c0f3-4e37-9b52-53057249cba6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49222025-01-25T00:20:10.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a8055c5a-c0f3-4e37-9b52-53057249cba6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49232025-01-25T00:20:10.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a8055c5a-c0f3-4e37-9b52-53057249cba6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49242025-01-25T00:20:10.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 552 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = d164897f-b36b-462a-8a9f-6cdc7611a92d response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
49252025-01-25T00:20:11.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4c883d92-c5f0-45cb-8833-aa37af8561ae roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49262025-01-25T00:20:11.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4c883d92-c5f0-45cb-8833-aa37af8561ae resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49272025-01-25T00:20:11.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4c883d92-c5f0-45cb-8833-aa37af8561ae response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49282025-01-25T00:20:12.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a15ef01b-9749-495d-aa37-419e5de9e9ea roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49292025-01-25T00:20:12.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a15ef01b-9749-495d-aa37-419e5de9e9ea resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49302025-01-25T00:20:12.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a15ef01b-9749-495d-aa37-419e5de9e9ea response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49312025-01-25T00:20:13.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd784eee-c476-4a14-b485-71f2b512449e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49322025-01-25T00:20:13.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd784eee-c476-4a14-b485-71f2b512449e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49332025-01-25T00:20:13.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fd784eee-c476-4a14-b485-71f2b512449e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49342025-01-25T00:20:14.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3fcc27a4-7561-449a-af76-59da0e925e3b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49352025-01-25T00:20:14.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3fcc27a4-7561-449a-af76-59da0e925e3b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49362025-01-25T00:20:14.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3fcc27a4-7561-449a-af76-59da0e925e3b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49372025-01-25T00:20:15.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0d938fe3-25ec-48d1-b85b-7796485177ce roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49382025-01-25T00:20:15.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0d938fe3-25ec-48d1-b85b-7796485177ce resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49392025-01-25T00:20:15.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0d938fe3-25ec-48d1-b85b-7796485177ce response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49402025-01-25T00:20:16.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1bb3a0e3-0f69-4061-954f-e09a599990b7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49412025-01-25T00:20:16.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1bb3a0e3-0f69-4061-954f-e09a599990b7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49422025-01-25T00:20:16.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1bb3a0e3-0f69-4061-954f-e09a599990b7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49432025-01-25T00:20:17.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bdda7916-adf7-4a73-9fca-01582e82e41c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49442025-01-25T00:20:17.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bdda7916-adf7-4a73-9fca-01582e82e41c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49452025-01-25T00:20:17.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bdda7916-adf7-4a73-9fca-01582e82e41c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49462025-01-25T00:20:18.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5a7d2532-7ea2-45e0-9651-cc0ce1c8dad9 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49472025-01-25T00:20:18.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5a7d2532-7ea2-45e0-9651-cc0ce1c8dad9 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49482025-01-25T00:20:18.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5a7d2532-7ea2-45e0-9651-cc0ce1c8dad9 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
49492025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
49502025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
49512025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
49522025-01-25T00:20:18.419ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2
49532025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.98\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2"}
49542025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
49552025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
49562025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
49572025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49582025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49592025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49602025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
49612025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49622025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
49632025-01-25T00:20:18.419ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-25 00:10:18.419667216 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
49642025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
49652025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
49662025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
49672025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
49682025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49692025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49702025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
49712025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49722025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
49732025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49742025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
49752025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
49762025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49772025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
49782025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
49792025-01-25T00:20:18.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
49802025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
49812025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
49822025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
49832025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49842025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
49852025-01-25T00:20:18.420ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
49862025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
49872025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49882025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
49892025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
49902025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49912025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
49922025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49932025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49942025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
49952025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49962025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49972025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
49982025-01-25T00:20:18.420ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49992025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50002025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50012025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
50022025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
50032025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50042025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50052025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
50062025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
50072025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50082025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50092025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50102025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
50112025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50122025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50132025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
50142025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
50152025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50162025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50172025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50182025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
50192025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50202025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
50212025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50222025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50232025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
50242025-01-25T00:20:18.420ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
50252025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50262025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
50272025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
50282025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50292025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
50302025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50312025-01-25T00:20:18.420ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
50322025-01-25T00:20:18.420ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
50332025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50342025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50352025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50362025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50372025-01-25T00:20:18.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
50382025-01-25T00:20:18.420ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22685765-7656-499f-8835-1c19f38e16e6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1541, tv_nsec: 140676008 } })
50392025-01-25T00:20:18.420ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("167a4f68-f407-48e5-a9a6-22f96a22bf2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3a6aa3c-ea79-4881-9aa5-b12ba496f837.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1541, tv_nsec: 140702628 } })
50402025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50412025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50422025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50432025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50442025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50452025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
50462025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50472025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50482025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
50492025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50502025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
50512025-01-25T00:20:18.421ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
50522025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50532025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50542025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
50552025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.390598ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
50562025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
50572025-01-25T00:20:18.421ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.659108ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
50582025-01-25T00:20:18.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50592025-01-25T00:20:18.423ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.209347ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50602025-01-25T00:20:18.423ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50612025-01-25T00:20:18.423ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-25 00:10:18.419667216 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
50622025-01-25T00:20:18.423ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.113542ms iteration = 11 status = {"expiration":"2025-01-25T00:10:18.419667216Z","pruned":[]}
50632025-01-25T00:20:18.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50642025-01-25T00:20:18.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50652025-01-25T00:20:18.424ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50662025-01-25T00:20:18.424ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50672025-01-25T00:20:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50682025-01-25T00:20:18.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
50692025-01-25T00:20:18.426ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50702025-01-25T00:20:18.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50712025-01-25T00:20:18.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50722025-01-25T00:20:18.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50732025-01-25T00:20:18.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50742025-01-25T00:20:18.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50752025-01-25T00:20:18.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50762025-01-25T00:20:18.427ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1541, tv_nsec: 147586534 } })
50772025-01-25T00:20:18.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50782025-01-25T00:20:18.427ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1541, tv_nsec: 147848245 } })
50792025-01-25T00:20:18.427ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
50802025-01-25T00:20:18.428ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
50812025-01-25T00:20:18.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50822025-01-25T00:20:18.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50832025-01-25T00:20:18.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50842025-01-25T00:20:18.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50852025-01-25T00:20:18.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50862025-01-25T00:20:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
50872025-01-25T00:20:18.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
50882025-01-25T00:20:18.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
50892025-01-25T00:20:18.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50902025-01-25T00:20:18.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50912025-01-25T00:20:18.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50922025-01-25T00:20:18.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50932025-01-25T00:20:18.433ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50942025-01-25T00:20:18.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50952025-01-25T00:20:18.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50962025-01-25T00:20:18.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50972025-01-25T00:20:18.433ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50982025-01-25T00:20:18.434ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50992025-01-25T00:20:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51002025-01-25T00:20:18.436ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51012025-01-25T00:20:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
51022025-01-25T00:20:18.436ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51032025-01-25T00:20:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51042025-01-25T00:20:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
51052025-01-25T00:20:18.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51062025-01-25T00:20:18.439ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.25372ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
51072025-01-25T00:20:18.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51082025-01-25T00:20:18.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51092025-01-25T00:20:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51102025-01-25T00:20:18.441ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51112025-01-25T00:20:18.441ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51122025-01-25T00:20:18.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51132025-01-25T00:20:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51142025-01-25T00:20:18.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51152025-01-25T00:20:18.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51162025-01-25T00:20:18.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51172025-01-25T00:20:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51182025-01-25T00:20:18.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51192025-01-25T00:20:18.447ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51202025-01-25T00:20:18.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51212025-01-25T00:20:18.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51222025-01-25T00:20:18.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51232025-01-25T00:20:18.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51242025-01-25T00:20:18.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51252025-01-25T00:20:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51262025-01-25T00:20:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51272025-01-25T00:20:18.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
51282025-01-25T00:20:18.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51292025-01-25T00:20:18.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
51302025-01-25T00:20:18.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51312025-01-25T00:20:18.451ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51322025-01-25T00:20:18.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1541, tv_nsec: 171595579 } })
51332025-01-25T00:20:18.452ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
51342025-01-25T00:20:18.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51352025-01-25T00:20:18.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51362025-01-25T00:20:18.456ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
51372025-01-25T00:20:18.456ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
51382025-01-25T00:20:18.456ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
51392025-01-25T00:20:18.456ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51402025-01-25T00:20:18.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51412025-01-25T00:20:18.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51422025-01-25T00:20:18.461ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51432025-01-25T00:20:18.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51442025-01-25T00:20:18.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51452025-01-25T00:20:18.475ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51462025-01-25T00:20:18.475ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51472025-01-25T00:20:18.475ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51482025-01-25T00:20:18.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51492025-01-25T00:20:18.475ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51502025-01-25T00:20:18.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51512025-01-25T00:20:18.480ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51522025-01-25T00:20:18.481ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51532025-01-25T00:20:18.485ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(5b9a19ef-3187-41ba-b0f0-6f0d0174a61c, 0), (1217046a-c631-49f3-9206-f5c193173a2a, 0), (718ea371-fd30-4f0a-912b-d9fd29c44234, 0), (607e80bb-1c5c-4ed3-972b-36f66380c3e8, 0)] collection_id = 5b9a19ef-3187-41ba-b0f0-6f0d0174a61c
51542025-01-25T00:20:18.485ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
51552025-01-25T00:20:18.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
51562025-01-25T00:20:18.485ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51572025-01-25T00:20:18.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51582025-01-25T00:20:18.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
51592025-01-25T00:20:18.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
51602025-01-25T00:20:18.486ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51612025-01-25T00:20:18.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51622025-01-25T00:20:18.490ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51632025-01-25T00:20:18.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51642025-01-25T00:20:18.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51652025-01-25T00:20:18.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51662025-01-25T00:20:18.493ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51672025-01-25T00:20:18.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51682025-01-25T00:20:18.497ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51692025-01-25T00:20:18.500ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51702025-01-25T00:20:18.500ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51712025-01-25T00:20:18.500ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.064197ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51722025-01-25T00:20:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51732025-01-25T00:20:18.501ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51742025-01-25T00:20:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51752025-01-25T00:20:18.504ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
51762025-01-25T00:20:18.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 84.150589ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
51772025-01-25T00:20:18.504ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 84.046368ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
51782025-01-25T00:20:18.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51792025-01-25T00:20:18.507ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51802025-01-25T00:20:18.508ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
51812025-01-25T00:20:18.508ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.478351ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
51822025-01-25T00:20:18.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51832025-01-25T00:20:18.510ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51842025-01-25T00:20:18.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51852025-01-25T00:20:18.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51862025-01-25T00:20:18.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51872025-01-25T00:20:18.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51882025-01-25T00:20:18.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 93.775618ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
51892025-01-25T00:20:18.514ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51902025-01-25T00:20:18.516ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51912025-01-25T00:20:18.516ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51922025-01-25T00:20:18.516ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 96.390882ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51932025-01-25T00:20:18.516ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51942025-01-25T00:20:18.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51952025-01-25T00:20:18.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51962025-01-25T00:20:18.517ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51972025-01-25T00:20:18.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51982025-01-25T00:20:18.520ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51992025-01-25T00:20:18.520ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52002025-01-25T00:20:18.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52012025-01-25T00:20:18.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52022025-01-25T00:20:18.525ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.745985ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52032025-01-25T00:20:18.551ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52042025-01-25T00:20:18.551ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52052025-01-25T00:20:18.551ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52062025-01-25T00:20:18.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52072025-01-25T00:20:18.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52082025-01-25T00:20:18.556ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52092025-01-25T00:20:18.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52102025-01-25T00:20:18.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52112025-01-25T00:20:18.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
52122025-01-25T00:20:18.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52132025-01-25T00:20:18.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
52142025-01-25T00:20:18.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52152025-01-25T00:20:18.566ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52162025-01-25T00:20:18.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52172025-01-25T00:20:18.568ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
52182025-01-25T00:20:18.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
52192025-01-25T00:20:18.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
52202025-01-25T00:20:18.569ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
52212025-01-25T00:20:18.569ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 150.086861ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
52222025-01-25T00:20:18.569ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52232025-01-25T00:20:18.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52242025-01-25T00:20:18.571ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52252025-01-25T00:20:18.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52262025-01-25T00:20:18.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
52272025-01-25T00:20:18.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52282025-01-25T00:20:18.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
52292025-01-25T00:20:18.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
52302025-01-25T00:20:18.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52312025-01-25T00:20:18.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
52322025-01-25T00:20:18.577ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 157.734612ms iteration = 21 status = 0
52332025-01-25T00:20:18.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 158.745247ms iteration = 5 status = {}
52342025-01-25T00:20:18.579ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
52352025-01-25T00:20:18.579ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 159.40664ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
52362025-01-25T00:20:18.581ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.204115ms iteration = 23 status = {"physical_disks_added":0}
52372025-01-25T00:20:18.585ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52382025-01-25T00:20:18.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52392025-01-25T00:20:18.587ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52402025-01-25T00:20:18.587ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 166.822688ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52412025-01-25T00:20:18.591ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52422025-01-25T00:20:18.591ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52432025-01-25T00:20:18.591ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.645508ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52442025-01-25T00:20:18.593ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 173.966956ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52452025-01-25T00:20:18.594ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52462025-01-25T00:20:18.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52472025-01-25T00:20:18.597ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
52482025-01-25T00:20:18.597ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52492025-01-25T00:20:18.598ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "118e3cd7-772e-4f72-b8d7-1623776419e8", "content-length": "26", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
52502025-01-25T00:20:18.598ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52512025-01-25T00:20:18.600ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
52522025-01-25T00:20:18.600ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 0 version = 2
52532025-01-25T00:20:18.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52542025-01-25T00:20:18.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52552025-01-25T00:20:18.601ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52562025-01-25T00:20:18.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 180.623341ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52572025-01-25T00:20:18.604ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
52582025-01-25T00:20:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
52592025-01-25T00:20:18.605ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52602025-01-25T00:20:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52612025-01-25T00:20:18.609ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52622025-01-25T00:20:18.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52632025-01-25T00:20:18.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 195.287107ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
52642025-01-25T00:20:18.615ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52652025-01-25T00:20:18.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52662025-01-25T00:20:18.616ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 5b9a19ef-3187-41ba-b0f0-6f0d0174a61c file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
52672025-01-25T00:20:18.616ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
52682025-01-25T00:20:18.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
52692025-01-25T00:20:18.617ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52702025-01-25T00:20:18.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52712025-01-25T00:20:18.620ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(1217046a-c631-49f3-9206-f5c193173a2a, 0), (718ea371-fd30-4f0a-912b-d9fd29c44234, 0), (607e80bb-1c5c-4ed3-972b-36f66380c3e8, 0)]
52722025-01-25T00:20:18.621ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1541, tv_nsec: 341343433 } })
52732025-01-25T00:20:18.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
52742025-01-25T00:20:18.623ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52752025-01-25T00:20:18.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52762025-01-25T00:20:18.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52772025-01-25T00:20:18.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52782025-01-25T00:20:18.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52792025-01-25T00:20:18.628ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52802025-01-25T00:20:18.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52812025-01-25T00:20:18.629ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
52822025-01-25T00:20:18.632ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
52832025-01-25T00:20:18.632ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52842025-01-25T00:20:18.632ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52852025-01-25T00:20:18.632ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "366dfa1f-b09d-42f3-bb2e-d2b4fd180e0f", "content-length": "26", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
52862025-01-25T00:20:18.632ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52872025-01-25T00:20:18.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52882025-01-25T00:20:18.634ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
52892025-01-25T00:20:18.634ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52902025-01-25T00:20:18.634ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "16a03c23-5530-4b5a-a606-aceecf88a702", "content-length": "26", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
52912025-01-25T00:20:18.634ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52922025-01-25T00:20:18.635ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52932025-01-25T00:20:18.637ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52942025-01-25T00:20:18.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52952025-01-25T00:20:18.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52962025-01-25T00:20:18.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52972025-01-25T00:20:18.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52982025-01-25T00:20:18.652ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52992025-01-25T00:20:18.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53002025-01-25T00:20:18.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53012025-01-25T00:20:18.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53022025-01-25T00:20:18.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53032025-01-25T00:20:18.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53042025-01-25T00:20:18.665ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
53052025-01-25T00:20:18.665ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
53062025-01-25T00:20:18.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53072025-01-25T00:20:18.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53082025-01-25T00:20:18.698ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
53092025-01-25T00:20:18.824ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53102025-01-25T00:20:18.824ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "62cede6b-9f0f-4ade-8e94-60f7069159ef", "content-length": "1", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53112025-01-25T00:20:18.826ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53122025-01-25T00:20:18.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53132025-01-25T00:20:18.842ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
53142025-01-25T00:20:18.842ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
53152025-01-25T00:20:18.842ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
53162025-01-25T00:20:18.842ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e50471c-59bd-405c-8b72-3de889453cb4", "content-length": "476", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53172025-01-25T00:20:18.842ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
53182025-01-25T00:20:18.842ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "39541094-b89a-455b-a7a2-e269e69c3ed3", "content-length": "734", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53192025-01-25T00:20:18.842ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
53202025-01-25T00:20:18.843ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b2a7cd8-bd6b-41db-a29e-973c2a924a95", "content-length": "111", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53212025-01-25T00:20:18.843ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
53222025-01-25T00:20:18.843ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "36611e55-f49d-404d-b2ba-80001f870adc", "content-length": "111", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53232025-01-25T00:20:18.843ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
53242025-01-25T00:20:18.844ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4be4169e-5525-44a4-8a56-7d80e42703ba", "content-length": "167", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53252025-01-25T00:20:18.844ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
53262025-01-25T00:20:18.844ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cc170bc-c735-4e37-9367-63113f8ec122", "content-length": "167", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53272025-01-25T00:20:18.844ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
53282025-01-25T00:20:18.844ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "71ba6597-a3c7-48f6-b163-679bf547041a", "content-length": "175", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53292025-01-25T00:20:18.844ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
53302025-01-25T00:20:18.845ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f8fab92-fd07-4fea-8415-134714e8d89d", "content-length": "175", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53312025-01-25T00:20:18.845ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
53322025-01-25T00:20:18.845ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "563a2e3b-37eb-45a2-9b88-13bbb1e9dcae", "content-length": "702", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53332025-01-25T00:20:18.845ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
53342025-01-25T00:20:18.845ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaca2335-44aa-46ec-9a91-2353f2b48e16", "content-length": "727", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53352025-01-25T00:20:18.845ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
53362025-01-25T00:20:18.846ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "67180655-2ca8-4c4d-904c-e27bae3b1d88", "content-length": "729", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53372025-01-25T00:20:18.846ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
53382025-01-25T00:20:18.846ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f9da49a-98ad-4c2e-a0f8-01bd0f23c982", "content-length": "728", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53392025-01-25T00:20:18.846ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
53402025-01-25T00:20:18.846ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4beb98b8-e052-4e20-8c31-fd4bfd770859", "content-length": "722", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53412025-01-25T00:20:18.846ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
53422025-01-25T00:20:18.847ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ff3d760-8c9b-4dcd-8ee8-4acf47d2a849", "content-length": "109", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53432025-01-25T00:20:18.847ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
53442025-01-25T00:20:18.847ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "94f45a94-6fbe-4e5f-bbfd-b13cfe22fc4b", "content-length": "109", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53452025-01-25T00:20:18.847ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
53462025-01-25T00:20:18.847ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d233695-2237-4399-af5d-5557692d9514", "content-length": "169", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53472025-01-25T00:20:18.847ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
53482025-01-25T00:20:18.848ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cf4c68c-6b1d-4836-9614-f593ba2d94b1", "content-length": "169", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53492025-01-25T00:20:18.848ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
53502025-01-25T00:20:18.848ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0a7d1cb-8354-41bd-b3db-07f5016c1b12", "content-length": "178", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53512025-01-25T00:20:18.848ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
53522025-01-25T00:20:18.848ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f682db20-da5a-47ae-864e-085660419097", "content-length": "178", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53532025-01-25T00:20:18.848ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
53542025-01-25T00:20:18.849ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2ca7670-ec7e-4de3-bab3-9d0be4ea2342", "content-length": "702", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53552025-01-25T00:20:18.849ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
53562025-01-25T00:20:18.849ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8005dca4-bf87-4c97-a6ad-1027309fd1b7", "content-length": "727", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53572025-01-25T00:20:18.849ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
53582025-01-25T00:20:18.849ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8455d5fd-d453-4cb8-80d6-814ed2176ef5", "content-length": "729", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53592025-01-25T00:20:18.849ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
53602025-01-25T00:20:18.849ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b52a2945-9240-4b9c-a6c9-a30bb31ecd9a", "content-length": "728", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53612025-01-25T00:20:18.849ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53622025-01-25T00:20:18.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
53632025-01-25T00:20:18.860ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
53642025-01-25T00:20:18.861ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9030da6b-b78b-4b49-8079-1f47bc54273a", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53652025-01-25T00:20:18.861ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53662025-01-25T00:20:18.865ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ee6633d6-5e8b-4476-93b3-29ed36d855c9", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53672025-01-25T00:20:18.865ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53682025-01-25T00:20:18.871ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53692025-01-25T00:20:18.871ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 451.759101ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
53702025-01-25T00:20:18.909ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
53712025-01-25T00:20:18.929ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53722025-01-25T00:20:18.929ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53732025-01-25T00:20:18.929ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa8b6008-e0de-4399-ab33-225adbf713ba", "content-length": "372", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
53742025-01-25T00:20:18.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53752025-01-25T00:20:18.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53762025-01-25T00:20:18.935ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53772025-01-25T00:20:18.935ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 1 version = 2
53782025-01-25T00:20:18.935ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
53792025-01-25T00:20:18.935ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-25 00:10:47.835608 UTC dns_group = external generation = 2
53802025-01-25T00:20:18.935ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 515.553874ms iteration = 11 status = {"generation":2}
53812025-01-25T00:20:18.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53822025-01-25T00:20:18.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53832025-01-25T00:20:18.936ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 516.916991ms iteration = 21 status = null
53842025-01-25T00:20:18.940ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53852025-01-25T00:20:18.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53862025-01-25T00:20:18.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53872025-01-25T00:20:18.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53882025-01-25T00:20:18.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
53892025-01-25T00:20:18.942ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
53902025-01-25T00:20:18.942ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 523.188054ms iteration = 21 status = {}
53912025-01-25T00:20:18.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
53922025-01-25T00:20:18.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53932025-01-25T00:20:18.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53942025-01-25T00:20:18.948ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
53952025-01-25T00:20:18.948ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
53962025-01-25T00:20:18.948ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53972025-01-25T00:20:18.948ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-25 00:10:46.879674 UTC dns_group = internal generation = 1
53982025-01-25T00:20:18.948ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 528.362051ms iteration = 11 status = {"generation":1}
53992025-01-25T00:20:18.948ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54002025-01-25T00:20:18.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54012025-01-25T00:20:18.950ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54022025-01-25T00:20:18.950ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
54032025-01-25T00:20:18.950ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
54042025-01-25T00:20:18.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54052025-01-25T00:20:18.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
54062025-01-25T00:20:18.952ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54072025-01-25T00:20:18.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
54082025-01-25T00:20:18.955ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54092025-01-25T00:20:18.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54102025-01-25T00:20:18.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54112025-01-25T00:20:18.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54122025-01-25T00:20:18.965ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54132025-01-25T00:20:18.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54142025-01-25T00:20:18.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54152025-01-25T00:20:18.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54162025-01-25T00:20:18.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54172025-01-25T00:20:18.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54182025-01-25T00:20:18.977ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54192025-01-25T00:20:18.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54202025-01-25T00:20:18.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54212025-01-25T00:20:18.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54222025-01-25T00:20:18.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54232025-01-25T00:20:18.984ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
54242025-01-25T00:20:18.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54252025-01-25T00:20:18.984ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54262025-01-25T00:20:18.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54272025-01-25T00:20:18.985ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-25T00:10:16.530962Z, time_modified: 2025-01-25T00:10:16.530962Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }) }
54282025-01-25T00:20:18.985ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 566.201228ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]}},"default_endpoint":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
54292025-01-25T00:20:18.986ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54302025-01-25T00:20:18.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54312025-01-25T00:20:18.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54322025-01-25T00:20:18.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54332025-01-25T00:20:18.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54342025-01-25T00:20:18.988ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54352025-01-25T00:20:18.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54362025-01-25T00:20:18.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54372025-01-25T00:20:18.989ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54382025-01-25T00:20:18.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54392025-01-25T00:20:18.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54402025-01-25T00:20:18.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54412025-01-25T00:20:18.994ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
54422025-01-25T00:20:18.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
54432025-01-25T00:20:18.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54442025-01-25T00:20:18.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54452025-01-25T00:20:18.995ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2fac727f-758e-4898-aafd-0c95f877fb20", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
54462025-01-25T00:20:18.995ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
54472025-01-25T00:20:18.997ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "966be263-d744-457d-a9cc-7e59d63bf63f", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
54482025-01-25T00:20:18.997ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
54492025-01-25T00:20:18.998ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
54502025-01-25T00:20:18.998ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54512025-01-25T00:20:18.998ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3db2bd91-a0f5-446f-a99d-b3ca739ff779", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
54522025-01-25T00:20:18.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54532025-01-25T00:20:18.999ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c89f1dae-a1eb-40b1-b761-6dcfdf6e6506", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
54542025-01-25T00:20:18.999ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
54552025-01-25T00:20:18.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54562025-01-25T00:20:18.999ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54572025-01-25T00:20:18.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54582025-01-25T00:20:19.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54592025-01-25T00:20:19.001ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
54602025-01-25T00:20:19.001ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 581.689258ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
54612025-01-25T00:20:19.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54622025-01-25T00:20:19.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54632025-01-25T00:20:19.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54642025-01-25T00:20:19.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54652025-01-25T00:20:19.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54662025-01-25T00:20:19.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54672025-01-25T00:20:19.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54682025-01-25T00:20:19.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54692025-01-25T00:20:19.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54702025-01-25T00:20:19.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54712025-01-25T00:20:19.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54722025-01-25T00:20:19.009ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54732025-01-25T00:20:19.009ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54742025-01-25T00:20:19.009ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5b22ddec-19b2-498d-aa45-23a393296797", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
54752025-01-25T00:20:19.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54762025-01-25T00:20:19.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54772025-01-25T00:20:19.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54782025-01-25T00:20:19.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54792025-01-25T00:20:19.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54802025-01-25T00:20:19.011ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 591.211879ms iteration = 21 status = {}
54812025-01-25T00:20:19.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54822025-01-25T00:20:19.012ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54832025-01-25T00:20:19.013ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
54842025-01-25T00:20:19.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54852025-01-25T00:20:19.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54862025-01-25T00:20:19.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
54872025-01-25T00:20:19.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54882025-01-25T00:20:19.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54892025-01-25T00:20:19.017ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54902025-01-25T00:20:19.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54912025-01-25T00:20:19.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54922025-01-25T00:20:19.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54932025-01-25T00:20:19.020ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54942025-01-25T00:20:19.024ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54952025-01-25T00:20:19.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
54962025-01-25T00:20:19.024ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54972025-01-25T00:20:19.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54982025-01-25T00:20:19.024ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "af96af12-10a5-46d8-a881-2b7f139f39f6", "content-length": "134", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
54992025-01-25T00:20:19.024ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55002025-01-25T00:20:19.024ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
55012025-01-25T00:20:19.025ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55022025-01-25T00:20:19.025ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55032025-01-25T00:20:19.025ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55042025-01-25T00:20:19.025ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55052025-01-25T00:20:19.025ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55062025-01-25T00:20:19.025ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55072025-01-25T00:20:19.025ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55082025-01-25T00:20:19.025ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55092025-01-25T00:20:19.025ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
55102025-01-25T00:20:19.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55112025-01-25T00:20:19.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55122025-01-25T00:20:19.027ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55132025-01-25T00:20:19.028ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "94a7da84-fd69-4baa-b569-82848b993f38", "content-length": "2", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
55142025-01-25T00:20:19.028ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55152025-01-25T00:20:19.028ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeb31f2d-ea87-47fe-afdd-2a4f5d338931", "content-length": "52", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
55162025-01-25T00:20:19.028ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
55172025-01-25T00:20:19.028ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55182025-01-25T00:20:19.031ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 3e7602ec-04be-4aee-8289-38cc36793714, kind: Service { id: 22685765-7656-499f-8835-1c19f38e16e6 }, name: Name("external-dns-22685765-7656-499f-8835-1c19f38e16e6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9177b433-e7bd-4285-a942-68884bcb366b, kind: Service { id: 68669e1f-c764-416e-9078-55cbc772328a }, name: Name("external-dns-68669e1f-c764-416e-9078-55cbc772328a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 145])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 25d62eb1-d2e8-4fc4-b282-46291224931e, kind: Service { id: af353237-4651-4023-8604-ee309f64048e }, name: Name("nexus-af353237-4651-4023-8604-ee309f64048e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3826f20-6642-4b59-81e8-ac53c0f47f3d, kind: Service { id: 8bff796d-a1b3-45c0-a35c-3cd6a40d03bc }, name: Name("nexus-8bff796d-a1b3-45c0-a35c-3cd6a40d03bc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed76ebe5-8c95-47b3-9c10-c2b972bb4743, kind: Service { id: fd38d148-0e8a-4c5e-af28-1c0123be0534 }, name: Name("nexus-fd38d148-0e8a-4c5e-af28-1c0123be0534"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 210])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
55192025-01-25T00:20:19.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55202025-01-25T00:20:19.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55212025-01-25T00:20:19.032ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55222025-01-25T00:20:19.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
55232025-01-25T00:20:19.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55242025-01-25T00:20:19.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55252025-01-25T00:20:19.036ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
55262025-01-25T00:20:19.036ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 3e7602ec-04be-4aee-8289-38cc36793714, kind: Service { id: 22685765-7656-499f-8835-1c19f38e16e6 }, name: Name("external-dns-22685765-7656-499f-8835-1c19f38e16e6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9177b433-e7bd-4285-a942-68884bcb366b, kind: Service { id: 68669e1f-c764-416e-9078-55cbc772328a }, name: Name("external-dns-68669e1f-c764-416e-9078-55cbc772328a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 145])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 25d62eb1-d2e8-4fc4-b282-46291224931e, kind: Service { id: af353237-4651-4023-8604-ee309f64048e }, name: Name("nexus-af353237-4651-4023-8604-ee309f64048e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3826f20-6642-4b59-81e8-ac53c0f47f3d, kind: Service { id: 8bff796d-a1b3-45c0-a35c-3cd6a40d03bc }, name: Name("nexus-8bff796d-a1b3-45c0-a35c-3cd6a40d03bc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 235])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed76ebe5-8c95-47b3-9c10-c2b972bb4743, kind: Service { id: fd38d148-0e8a-4c5e-af28-1c0123be0534 }, name: Name("nexus-fd38d148-0e8a-4c5e-af28-1c0123be0534"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 210])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
55272025-01-25T00:20:19.036ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
55282025-01-25T00:20:19.085ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
55292025-01-25T00:20:19.085ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
55302025-01-25T00:20:19.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55312025-01-25T00:20:19.135ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "83dc21af-ee06-4566-9493-dddf834594c7", "date": "Sat, 25 Jan 2025 00:20:18 GMT"} })
55322025-01-25T00:20:19.135ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
55332025-01-25T00:20:19.135ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55342025-01-25T00:20:19.136ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "69a03622-c655-4d1c-8168-04e3d76a1b67", "content-length": "691", "date": "Sat, 25 Jan 2025 00:20:19 GMT"} })
55352025-01-25T00:20:19.136ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "73f7caba-1bcd-46ee-ae28-568c090a098f", "content-length": "682", "date": "Sat, 25 Jan 2025 00:20:19 GMT"} })
55362025-01-25T00:20:19.136ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
55372025-01-25T00:20:19.136ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
55382025-01-25T00:20:19.136ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
55392025-01-25T00:20:19.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55402025-01-25T00:20:19.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55412025-01-25T00:20:19.137ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 718.011459ms iteration = 21 status = {}
55422025-01-25T00:20:19.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55432025-01-25T00:20:19.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55442025-01-25T00:20:19.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55452025-01-25T00:20:19.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55462025-01-25T00:20:19.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55472025-01-25T00:20:19.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55482025-01-25T00:20:19.154ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 734.263253ms iteration = 21 status = {}
55492025-01-25T00:20:19.158ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, time_created: 2025-01-25T00:10:44.486066Z, time_modified: 2025-01-25T00:10:44.486066Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
55502025-01-25T00:20:19.158ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
55512025-01-25T00:20:19.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55522025-01-25T00:20:19.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55532025-01-25T00:20:19.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55542025-01-25T00:20:19.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55552025-01-25T00:20:19.162ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55562025-01-25T00:20:19.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
55572025-01-25T00:20:19.199ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
55582025-01-25T00:20:19.200ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "5d21c5de-e3fd-4020-b343-c10715dfd0c0", "date": "Sat, 25 Jan 2025 00:20:19 GMT"} })
55592025-01-25T00:20:19.201ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
55602025-01-25T00:20:19.201ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 780.704835ms
55612025-01-25T00:20:19.201ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 780.713985ms iteration = 3 status = {}
55622025-01-25T00:20:19.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08691615-ca0f-4850-980b-e8a25eb8999f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
55632025-01-25T00:20:19.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08691615-ca0f-4850-980b-e8a25eb8999f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
55642025-01-25T00:20:19.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08691615-ca0f-4850-980b-e8a25eb8999f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
55652025-01-25T00:20:19.473ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "9df8a89f-a074-49b8-8bbc-9d672b7bba21", "content-length": "30803", "date": "Sat, 25 Jan 2025 00:20:19 GMT"} })
55662025-01-25T00:20:19.475ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
55672025-01-25T00:20:19.475ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
55682025-01-25T00:20:19.475ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
55692025-01-25T00:20:19.477ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
55702025-01-25T00:20:19.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
55712025-01-25T00:20:19.479ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55722025-01-25T00:20:19.481ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
55732025-01-25T00:20:19.481ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
55742025-01-25T00:20:19.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
55752025-01-25T00:20:19.655ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 0d424bbb-2204-4252-95b1-d29257c04670 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
55762025-01-25T00:20:19.655ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 0d424bbb-2204-4252-95b1-d29257c04670 time_started = 2025-01-25 00:20:18.842080 UTC
55772025-01-25T00:20:19.655ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.235676584s iteration = 3 status = {"collection_id":"0d424bbb-2204-4252-95b1-d29257c04670","time_done":"2025-01-25 00:20:19.475886 UTC","time_started":"2025-01-25 00:20:18.842080 UTC"}
55782025-01-25T00:20:19.655ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
55792025-01-25T00:20:19.655ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
55802025-01-25T00:20:19.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
55812025-01-25T00:20:19.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55822025-01-25T00:20:19.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55832025-01-25T00:20:19.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55842025-01-25T00:20:19.657ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55852025-01-25T00:20:19.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55862025-01-25T00:20:19.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55872025-01-25T00:20:19.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55882025-01-25T00:20:19.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55892025-01-25T00:20:19.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
55902025-01-25T00:20:19.661ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
55912025-01-25T00:20:19.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
55922025-01-25T00:20:19.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55932025-01-25T00:20:19.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55942025-01-25T00:20:19.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55952025-01-25T00:20:19.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55962025-01-25T00:20:19.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55972025-01-25T00:20:19.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55982025-01-25T00:20:19.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 5a7272f7-cff2-493c-b017-269ed6603cd2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55992025-01-25T00:20:19.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 5a7272f7-cff2-493c-b017-269ed6603cd2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
56002025-01-25T00:20:19.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 5a7272f7-cff2-493c-b017-269ed6603cd2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
56012025-01-25T00:20:19.715ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 60.059943ms iteration = 24 status = {"physical_disks_added":0}
56022025-01-25T00:20:19.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
56032025-01-25T00:20:19.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
56042025-01-25T00:20:19.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
56052025-01-25T00:20:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
56062025-01-25T00:20:19.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56072025-01-25T00:20:19.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
56082025-01-25T00:20:19.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
56092025-01-25T00:20:19.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
56102025-01-25T00:20:19.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56112025-01-25T00:20:19.804ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
56122025-01-25T00:20:19.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
56132025-01-25T00:20:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
56142025-01-25T00:20:19.806ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 151.246747ms iteration = 6 status = {}
56152025-01-25T00:20:20.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0c385967-ee04-4ee6-abc2-bdbf4fb97e6d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56162025-01-25T00:20:20.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0c385967-ee04-4ee6-abc2-bdbf4fb97e6d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56172025-01-25T00:20:20.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0c385967-ee04-4ee6-abc2-bdbf4fb97e6d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56182025-01-25T00:20:20.984ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 555 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 4e0276dc-2752-45ba-864b-273477f933c4 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
56192025-01-25T00:20:21.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bb4dddd2-379c-48e9-ae5e-878010f06664 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56202025-01-25T00:20:21.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bb4dddd2-379c-48e9-ae5e-878010f06664 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56212025-01-25T00:20:21.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bb4dddd2-379c-48e9-ae5e-878010f06664 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56222025-01-25T00:20:22.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e598eb1d-6856-4899-a994-6251337fbd17 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56232025-01-25T00:20:22.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e598eb1d-6856-4899-a994-6251337fbd17 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56242025-01-25T00:20:22.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e598eb1d-6856-4899-a994-6251337fbd17 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56252025-01-25T00:20:23.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7daaab5b-65fe-47e5-b85d-fd3763b9bd8d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56262025-01-25T00:20:23.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7daaab5b-65fe-47e5-b85d-fd3763b9bd8d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56272025-01-25T00:20:23.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7daaab5b-65fe-47e5-b85d-fd3763b9bd8d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56282025-01-25T00:20:24.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cccaecf9-a05e-4aba-90d1-b54efd47daa7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56292025-01-25T00:20:24.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cccaecf9-a05e-4aba-90d1-b54efd47daa7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56302025-01-25T00:20:24.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cccaecf9-a05e-4aba-90d1-b54efd47daa7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56312025-01-25T00:20:25.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d304005c-40f4-4714-9bef-2ad2d38815aa roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56322025-01-25T00:20:25.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d304005c-40f4-4714-9bef-2ad2d38815aa resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56332025-01-25T00:20:25.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d304005c-40f4-4714-9bef-2ad2d38815aa response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56342025-01-25T00:20:26.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 858332e5-3a46-4975-bd9f-852668ec611d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56352025-01-25T00:20:26.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 858332e5-3a46-4975-bd9f-852668ec611d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56362025-01-25T00:20:26.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 858332e5-3a46-4975-bd9f-852668ec611d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56372025-01-25T00:20:27.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 10b7adc0-5a3e-456b-afe4-4df6dda09b5f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56382025-01-25T00:20:27.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 10b7adc0-5a3e-456b-afe4-4df6dda09b5f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56392025-01-25T00:20:27.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 10b7adc0-5a3e-456b-afe4-4df6dda09b5f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56402025-01-25T00:20:28.420ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
56412025-01-25T00:20:28.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56422025-01-25T00:20:28.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56432025-01-25T00:20:28.421ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
56442025-01-25T00:20:28.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56452025-01-25T00:20:28.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56462025-01-25T00:20:28.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56472025-01-25T00:20:28.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56482025-01-25T00:20:28.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56492025-01-25T00:20:28.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56502025-01-25T00:20:28.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56512025-01-25T00:20:28.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56522025-01-25T00:20:28.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56532025-01-25T00:20:28.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
56542025-01-25T00:20:28.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56552025-01-25T00:20:28.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56562025-01-25T00:20:28.445ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
56572025-01-25T00:20:28.445ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.223571ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
56582025-01-25T00:20:28.455ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56592025-01-25T00:20:28.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56602025-01-25T00:20:28.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.17663ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56612025-01-25T00:20:28.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b6be0db9-a56d-4761-bc58-23fd1af5774b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56622025-01-25T00:20:28.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b6be0db9-a56d-4761-bc58-23fd1af5774b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56632025-01-25T00:20:28.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b6be0db9-a56d-4761-bc58-23fd1af5774b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56642025-01-25T00:20:29.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e8c98d0b-17a2-428f-adec-bf9813a8f7f2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56652025-01-25T00:20:29.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e8c98d0b-17a2-428f-adec-bf9813a8f7f2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56662025-01-25T00:20:29.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e8c98d0b-17a2-428f-adec-bf9813a8f7f2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56672025-01-25T00:20:30.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e7ea1e59-79bf-438a-aa80-c9d33ffc68d6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56682025-01-25T00:20:30.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e7ea1e59-79bf-438a-aa80-c9d33ffc68d6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56692025-01-25T00:20:30.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e7ea1e59-79bf-438a-aa80-c9d33ffc68d6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56702025-01-25T00:20:30.984ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 542 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = d9650ed3-9e90-4d08-a3a1-04e7a00eaca7 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
56712025-01-25T00:20:31.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = df63f35b-215b-4729-8d8d-4855571aa188 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56722025-01-25T00:20:31.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = df63f35b-215b-4729-8d8d-4855571aa188 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56732025-01-25T00:20:31.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = df63f35b-215b-4729-8d8d-4855571aa188 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56742025-01-25T00:20:32.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4429a716-02e2-4860-91d1-809db690abbb roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56752025-01-25T00:20:32.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4429a716-02e2-4860-91d1-809db690abbb resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56762025-01-25T00:20:32.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4429a716-02e2-4860-91d1-809db690abbb response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56772025-01-25T00:20:33.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8a2e5995-f2cd-423a-9e52-d322cad05964 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56782025-01-25T00:20:33.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8a2e5995-f2cd-423a-9e52-d322cad05964 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56792025-01-25T00:20:33.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8a2e5995-f2cd-423a-9e52-d322cad05964 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56802025-01-25T00:20:34.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 60954ed3-13b2-4f29-a38a-b80f6fbea0c2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56812025-01-25T00:20:34.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 60954ed3-13b2-4f29-a38a-b80f6fbea0c2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56822025-01-25T00:20:34.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 60954ed3-13b2-4f29-a38a-b80f6fbea0c2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56832025-01-25T00:20:35.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2b0ae602-02a2-4e7c-bbd6-571f4e9ae1a1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56842025-01-25T00:20:35.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2b0ae602-02a2-4e7c-bbd6-571f4e9ae1a1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56852025-01-25T00:20:35.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2b0ae602-02a2-4e7c-bbd6-571f4e9ae1a1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56862025-01-25T00:20:36.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08f0f08e-f1de-461e-acda-cdecdd8cfe53 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56872025-01-25T00:20:36.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08f0f08e-f1de-461e-acda-cdecdd8cfe53 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56882025-01-25T00:20:36.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 08f0f08e-f1de-461e-acda-cdecdd8cfe53 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56892025-01-25T00:20:37.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dedab0cd-e91b-4bf7-ba41-146dc8bd0bf1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56902025-01-25T00:20:37.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dedab0cd-e91b-4bf7-ba41-146dc8bd0bf1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56912025-01-25T00:20:37.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dedab0cd-e91b-4bf7-ba41-146dc8bd0bf1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
56922025-01-25T00:20:38.419ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
56932025-01-25T00:20:38.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56942025-01-25T00:20:38.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56952025-01-25T00:20:38.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56962025-01-25T00:20:38.421ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
56972025-01-25T00:20:38.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56982025-01-25T00:20:38.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56992025-01-25T00:20:38.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57002025-01-25T00:20:38.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57012025-01-25T00:20:38.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57022025-01-25T00:20:38.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57032025-01-25T00:20:38.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57042025-01-25T00:20:38.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57052025-01-25T00:20:38.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
57062025-01-25T00:20:38.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57072025-01-25T00:20:38.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57082025-01-25T00:20:38.440ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
57092025-01-25T00:20:38.440ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.956438ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
57102025-01-25T00:20:38.457ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57112025-01-25T00:20:38.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57122025-01-25T00:20:38.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.947638ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57132025-01-25T00:20:38.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9e5869ab-a1c2-4952-858e-00e2b8074833 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57142025-01-25T00:20:38.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9e5869ab-a1c2-4952-858e-00e2b8074833 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57152025-01-25T00:20:38.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9e5869ab-a1c2-4952-858e-00e2b8074833 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57162025-01-25T00:20:39.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b4642155-8e2f-4be3-900b-4a5d2c3bd138 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57172025-01-25T00:20:39.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b4642155-8e2f-4be3-900b-4a5d2c3bd138 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57182025-01-25T00:20:39.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b4642155-8e2f-4be3-900b-4a5d2c3bd138 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57192025-01-25T00:20:40.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0350ab0c-4648-40af-ba74-484ea6c7c228 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57202025-01-25T00:20:40.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0350ab0c-4648-40af-ba74-484ea6c7c228 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57212025-01-25T00:20:40.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0350ab0c-4648-40af-ba74-484ea6c7c228 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57222025-01-25T00:20:40.984ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 480 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 60ea4f52-c248-4497-a42c-f1b6996590ca response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
57232025-01-25T00:20:41.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ca247608-3bcd-49df-b8c9-95ce5514af84 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57242025-01-25T00:20:41.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ca247608-3bcd-49df-b8c9-95ce5514af84 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57252025-01-25T00:20:41.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ca247608-3bcd-49df-b8c9-95ce5514af84 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57262025-01-25T00:20:42.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c451683a-3627-48ab-9261-ab5b8d746e8e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57272025-01-25T00:20:42.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c451683a-3627-48ab-9261-ab5b8d746e8e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57282025-01-25T00:20:42.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c451683a-3627-48ab-9261-ab5b8d746e8e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57292025-01-25T00:20:43.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6aa69041-a9bf-401c-b7fe-69ae34d46728 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57302025-01-25T00:20:43.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6aa69041-a9bf-401c-b7fe-69ae34d46728 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57312025-01-25T00:20:43.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6aa69041-a9bf-401c-b7fe-69ae34d46728 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57322025-01-25T00:20:44.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 40577e9a-772f-444e-9d69-22e555660078 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57332025-01-25T00:20:44.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 40577e9a-772f-444e-9d69-22e555660078 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57342025-01-25T00:20:44.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2580 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 40577e9a-772f-444e-9d69-22e555660078 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57352025-01-25T00:20:45.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 50f38655-5091-4c1c-830b-775a7082c21c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57362025-01-25T00:20:45.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 50f38655-5091-4c1c-830b-775a7082c21c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57372025-01-25T00:20:45.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 50f38655-5091-4c1c-830b-775a7082c21c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57382025-01-25T00:20:46.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1829d2de-e89f-4bba-aba7-ad0b7ffa25e4 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57392025-01-25T00:20:46.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1829d2de-e89f-4bba-aba7-ad0b7ffa25e4 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57402025-01-25T00:20:46.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1829d2de-e89f-4bba-aba7-ad0b7ffa25e4 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57412025-01-25T00:20:47.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3092b423-2d06-4691-bb1e-6af425fa2787 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57422025-01-25T00:20:47.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3092b423-2d06-4691-bb1e-6af425fa2787 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57432025-01-25T00:20:47.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3092b423-2d06-4691-bb1e-6af425fa2787 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
57442025-01-25T00:20:48.420ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
57452025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
57462025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57472025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
57482025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57492025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57502025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
57512025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
57522025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
57532025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
57542025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57552025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57562025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57572025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
57582025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57592025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
57602025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57612025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
57622025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57632025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
57642025-01-25T00:20:48.421ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57652025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57662025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
57672025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57682025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
57692025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57702025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
57712025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57722025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
57732025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57742025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
57752025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57762025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57772025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
57782025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57792025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
57802025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57812025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57822025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57832025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57842025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57852025-01-25T00:20:48.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57862025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57872025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57882025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57892025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57902025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57912025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57922025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57932025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57942025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57952025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57962025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57972025-01-25T00:20:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57982025-01-25T00:20:48.423ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57992025-01-25T00:20:48.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58002025-01-25T00:20:48.424ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58012025-01-25T00:20:48.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58022025-01-25T00:20:48.424ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.965121ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58032025-01-25T00:20:48.425ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1571, tv_nsec: 145085601 } })
58042025-01-25T00:20:48.426ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
58052025-01-25T00:20:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58062025-01-25T00:20:48.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58072025-01-25T00:20:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
58082025-01-25T00:20:48.426ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58092025-01-25T00:20:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58102025-01-25T00:20:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58112025-01-25T00:20:48.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58122025-01-25T00:20:48.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58132025-01-25T00:20:48.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58142025-01-25T00:20:48.428ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58152025-01-25T00:20:48.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58162025-01-25T00:20:48.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58172025-01-25T00:20:48.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58182025-01-25T00:20:48.428ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1571, tv_nsec: 147985536 } })
58192025-01-25T00:20:48.428ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
58202025-01-25T00:20:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58212025-01-25T00:20:48.430ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58222025-01-25T00:20:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58232025-01-25T00:20:48.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58242025-01-25T00:20:48.432ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58252025-01-25T00:20:48.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58262025-01-25T00:20:48.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58272025-01-25T00:20:48.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58282025-01-25T00:20:48.437ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1571, tv_nsec: 156603391 } })
58292025-01-25T00:20:48.437ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
58302025-01-25T00:20:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58312025-01-25T00:20:48.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58322025-01-25T00:20:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58332025-01-25T00:20:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58342025-01-25T00:20:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58352025-01-25T00:20:48.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58362025-01-25T00:20:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58372025-01-25T00:20:48.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58382025-01-25T00:20:48.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58392025-01-25T00:20:48.485ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58402025-01-25T00:20:48.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58412025-01-25T00:20:48.486ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58422025-01-25T00:20:48.486ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58432025-01-25T00:20:48.486ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58442025-01-25T00:20:48.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58452025-01-25T00:20:48.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58462025-01-25T00:20:48.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58472025-01-25T00:20:48.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.302181ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
58482025-01-25T00:20:48.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.507103ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
58492025-01-25T00:20:48.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58502025-01-25T00:20:48.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58512025-01-25T00:20:48.494ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58522025-01-25T00:20:48.494ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58532025-01-25T00:20:48.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58542025-01-25T00:20:48.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58552025-01-25T00:20:48.496ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58562025-01-25T00:20:48.497ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58572025-01-25T00:20:48.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58582025-01-25T00:20:48.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
58592025-01-25T00:20:48.498ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58602025-01-25T00:20:48.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58612025-01-25T00:20:48.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58622025-01-25T00:20:48.505ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58632025-01-25T00:20:48.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58642025-01-25T00:20:48.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58652025-01-25T00:20:48.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58662025-01-25T00:20:48.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58672025-01-25T00:20:48.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.901373ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58682025-01-25T00:20:48.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58692025-01-25T00:20:48.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58702025-01-25T00:20:48.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58712025-01-25T00:20:48.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
58722025-01-25T00:20:48.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58732025-01-25T00:20:48.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58742025-01-25T00:20:48.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58752025-01-25T00:20:48.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58762025-01-25T00:20:48.514ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58772025-01-25T00:20:48.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58782025-01-25T00:20:48.515ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
58792025-01-25T00:20:48.515ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58802025-01-25T00:20:48.515ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a16080c3-d4ee-4bfb-992e-d43e7fecac5e", "content-length": "26", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
58812025-01-25T00:20:48.515ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58822025-01-25T00:20:48.519ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58832025-01-25T00:20:48.523ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58842025-01-25T00:20:48.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58852025-01-25T00:20:48.527ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58862025-01-25T00:20:48.527ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.435044ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58872025-01-25T00:20:48.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 111.690032ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
58882025-01-25T00:20:48.533ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
58892025-01-25T00:20:48.533ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58902025-01-25T00:20:48.533ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "814cf11d-1073-4643-973b-bebe907a75bc", "content-length": "26", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
58912025-01-25T00:20:48.533ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58922025-01-25T00:20:48.535ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58932025-01-25T00:20:48.538ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 116.950959ms iteration = 25 status = {"physical_disks_added":0}
58942025-01-25T00:20:48.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58952025-01-25T00:20:48.541ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58962025-01-25T00:20:48.541ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58972025-01-25T00:20:48.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58982025-01-25T00:20:48.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58992025-01-25T00:20:48.542ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
59002025-01-25T00:20:48.542ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 121.521583ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
59012025-01-25T00:20:48.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
59022025-01-25T00:20:48.544ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59032025-01-25T00:20:48.544ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59042025-01-25T00:20:48.544ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.338602ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59052025-01-25T00:20:48.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59062025-01-25T00:20:48.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59072025-01-25T00:20:48.549ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 128.348818ms iteration = 22 status = 0
59082025-01-25T00:20:48.549ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
59092025-01-25T00:20:48.549ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 128.973041ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
59102025-01-25T00:20:48.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 131.639755ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59112025-01-25T00:20:48.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 137.889549ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59122025-01-25T00:20:48.560ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
59132025-01-25T00:20:48.560ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59142025-01-25T00:20:48.561ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e78b4ba6-01ec-4726-bfdc-e6ad936a8c7a", "content-length": "26", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
59152025-01-25T00:20:48.561ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59162025-01-25T00:20:48.562ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
59172025-01-25T00:20:48.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59182025-01-25T00:20:48.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59192025-01-25T00:20:48.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59202025-01-25T00:20:48.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59212025-01-25T00:20:48.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59222025-01-25T00:20:48.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59232025-01-25T00:20:48.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59242025-01-25T00:20:48.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59252025-01-25T00:20:48.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59262025-01-25T00:20:48.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59272025-01-25T00:20:48.638ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59282025-01-25T00:20:48.639ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "aedea192-2c3f-422a-8b74-f1652d01fe19", "content-length": "1", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
59292025-01-25T00:20:48.640ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59302025-01-25T00:20:48.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59312025-01-25T00:20:48.643ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 221.930066ms iteration = 22 status = null
59322025-01-25T00:20:48.692ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 271.250143ms iteration = 22 status = {}
59332025-01-25T00:20:48.718ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59342025-01-25T00:20:48.718ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59352025-01-25T00:20:48.719ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e030b0ca-38e4-4092-b877-f449bb08d083", "content-length": "372", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
59362025-01-25T00:20:48.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59372025-01-25T00:20:48.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59382025-01-25T00:20:48.755ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59392025-01-25T00:20:48.756ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b9b9176-a3ce-4bec-ab2c-5804901db89b", "content-length": "691", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
59402025-01-25T00:20:48.756ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59412025-01-25T00:20:48.756ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59422025-01-25T00:20:48.756ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59432025-01-25T00:20:48.758ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 337.108335ms iteration = 22 status = {}
59442025-01-25T00:20:48.774ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
59452025-01-25T00:20:48.774ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59462025-01-25T00:20:48.775ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1245140b-98d9-439d-a23b-30d8cd01c66b", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
59472025-01-25T00:20:48.775ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59482025-01-25T00:20:48.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59492025-01-25T00:20:48.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59502025-01-25T00:20:48.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59512025-01-25T00:20:48.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59522025-01-25T00:20:48.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59532025-01-25T00:20:48.786ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59542025-01-25T00:20:48.786ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59552025-01-25T00:20:48.787ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ed7950eb-8238-41b2-a6d3-edf1ead86fac", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
59562025-01-25T00:20:48.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59572025-01-25T00:20:48.789ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 368.410678ms iteration = 22 status = {}
59582025-01-25T00:20:48.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59592025-01-25T00:20:48.791ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
59602025-01-25T00:20:48.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59612025-01-25T00:20:48.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59622025-01-25T00:20:48.804ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
59632025-01-25T00:20:48.804ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "77010011-df51-4d9d-9f45-320ab09072cd", "content-length": "134", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
59642025-01-25T00:20:48.804ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
59652025-01-25T00:20:48.804ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
59662025-01-25T00:20:48.805ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59672025-01-25T00:20:48.805ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59682025-01-25T00:20:48.805ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59692025-01-25T00:20:48.805ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59702025-01-25T00:20:48.805ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59712025-01-25T00:20:48.805ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59722025-01-25T00:20:48.805ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59732025-01-25T00:20:48.805ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59742025-01-25T00:20:48.805ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
59752025-01-25T00:20:48.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59762025-01-25T00:20:48.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59772025-01-25T00:20:48.808ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59782025-01-25T00:20:48.808ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "35343f37-29d9-42db-b8a7-c22e4d01c09d", "content-length": "2", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
59792025-01-25T00:20:48.808ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59802025-01-25T00:20:48.808ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "27320c16-b995-46ad-a2f6-71a81dad6c1d", "content-length": "52", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
59812025-01-25T00:20:48.808ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
59822025-01-25T00:20:48.808ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59832025-01-25T00:20:48.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ecdc4e5e-85b8-4801-bdca-af254591052a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
59842025-01-25T00:20:48.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ecdc4e5e-85b8-4801-bdca-af254591052a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
59852025-01-25T00:20:48.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ecdc4e5e-85b8-4801-bdca-af254591052a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
59862025-01-25T00:20:49.089ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a9b84f57-08f1-4706-b771-08caaf3bc9d1", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
59872025-01-25T00:20:49.089ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
59882025-01-25T00:20:49.089ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59892025-01-25T00:20:49.089ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f10f7db-0590-4fd0-bba1-561fb7056d4a", "content-length": "682", "date": "Sat, 25 Jan 2025 00:20:48 GMT"} })
59902025-01-25T00:20:49.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59912025-01-25T00:20:49.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59922025-01-25T00:20:49.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59932025-01-25T00:20:49.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59942025-01-25T00:20:49.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59952025-01-25T00:20:49.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59962025-01-25T00:20:49.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59972025-01-25T00:20:49.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59982025-01-25T00:20:49.109ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 688.363464ms iteration = 22 status = {}
59992025-01-25T00:20:49.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 2a847aa2-80fa-4b82-87f8-da29418341c9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
60002025-01-25T00:20:49.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 2a847aa2-80fa-4b82-87f8-da29418341c9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
60012025-01-25T00:20:49.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 2a847aa2-80fa-4b82-87f8-da29418341c9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
60022025-01-25T00:20:50.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9b4c7ba0-e5c9-4ddd-8e8d-6dd9efa7f040 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60032025-01-25T00:20:50.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9b4c7ba0-e5c9-4ddd-8e8d-6dd9efa7f040 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60042025-01-25T00:20:50.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9b4c7ba0-e5c9-4ddd-8e8d-6dd9efa7f040 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60052025-01-25T00:20:50.984ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 493 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = c5789b29-ef4f-4fde-aafe-b653ed18dbe7 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
60062025-01-25T00:20:51.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = efd901df-0d15-4ee9-851b-e31455451592 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60072025-01-25T00:20:51.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = efd901df-0d15-4ee9-851b-e31455451592 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60082025-01-25T00:20:51.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = efd901df-0d15-4ee9-851b-e31455451592 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60092025-01-25T00:20:52.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = da43ae34-aceb-4878-a17c-ecd32aa2fd9e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60102025-01-25T00:20:52.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = da43ae34-aceb-4878-a17c-ecd32aa2fd9e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60112025-01-25T00:20:52.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = da43ae34-aceb-4878-a17c-ecd32aa2fd9e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60122025-01-25T00:20:53.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 34ed1d65-7709-478b-85d3-da625f75e4ed roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60132025-01-25T00:20:53.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 34ed1d65-7709-478b-85d3-da625f75e4ed resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60142025-01-25T00:20:53.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 34ed1d65-7709-478b-85d3-da625f75e4ed response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60152025-01-25T00:20:54.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7439e0e6-b0b0-426b-a616-dc4c8ec11730 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60162025-01-25T00:20:54.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7439e0e6-b0b0-426b-a616-dc4c8ec11730 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60172025-01-25T00:20:54.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7439e0e6-b0b0-426b-a616-dc4c8ec11730 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60182025-01-25T00:20:55.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ed892ac5-577b-4acd-a22c-9ce2c32a53b2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60192025-01-25T00:20:55.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ed892ac5-577b-4acd-a22c-9ce2c32a53b2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60202025-01-25T00:20:55.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ed892ac5-577b-4acd-a22c-9ce2c32a53b2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60212025-01-25T00:20:56.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f34d33d0-c491-4ad9-88f3-d1267f923eaf roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60222025-01-25T00:20:56.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f34d33d0-c491-4ad9-88f3-d1267f923eaf resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60232025-01-25T00:20:56.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f34d33d0-c491-4ad9-88f3-d1267f923eaf response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60242025-01-25T00:20:57.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = abdc86c4-71c2-4139-86b5-12200795831f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60252025-01-25T00:20:57.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = abdc86c4-71c2-4139-86b5-12200795831f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60262025-01-25T00:20:57.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = abdc86c4-71c2-4139-86b5-12200795831f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60272025-01-25T00:20:58.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b1fc0f69-bf31-4620-b29c-ad3566f65031 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60282025-01-25T00:20:58.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b1fc0f69-bf31-4620-b29c-ad3566f65031 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60292025-01-25T00:20:58.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b1fc0f69-bf31-4620-b29c-ad3566f65031 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60302025-01-25T00:20:58.421ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
60312025-01-25T00:20:58.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
60322025-01-25T00:20:58.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60332025-01-25T00:20:58.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60342025-01-25T00:20:58.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60352025-01-25T00:20:58.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60362025-01-25T00:20:58.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60372025-01-25T00:20:58.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60382025-01-25T00:20:58.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60392025-01-25T00:20:58.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60402025-01-25T00:20:58.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60412025-01-25T00:20:58.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60422025-01-25T00:20:58.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60432025-01-25T00:20:58.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60442025-01-25T00:20:58.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60452025-01-25T00:20:58.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
60462025-01-25T00:20:58.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60472025-01-25T00:20:58.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60482025-01-25T00:20:58.443ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
60492025-01-25T00:20:58.443ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.697843ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
60502025-01-25T00:20:58.452ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.169002ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60512025-01-25T00:20:59.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7d561d6b-2dcd-4010-acf9-6ae1bbe3290f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60522025-01-25T00:20:59.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7d561d6b-2dcd-4010-acf9-6ae1bbe3290f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60532025-01-25T00:20:59.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7d561d6b-2dcd-4010-acf9-6ae1bbe3290f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60542025-01-25T00:21:00.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b345dea9-1744-439c-8f74-171a542d8ad9 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60552025-01-25T00:21:00.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b345dea9-1744-439c-8f74-171a542d8ad9 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60562025-01-25T00:21:00.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b345dea9-1744-439c-8f74-171a542d8ad9 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60572025-01-25T00:21:00.984ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 477 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 25405d8e-2f17-477f-ab6f-eae995473b1e response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
60582025-01-25T00:21:01.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c38c2120-cd54-4354-ac32-a77d6c238ca7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60592025-01-25T00:21:01.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c38c2120-cd54-4354-ac32-a77d6c238ca7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60602025-01-25T00:21:01.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c38c2120-cd54-4354-ac32-a77d6c238ca7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60612025-01-25T00:21:02.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b91ca2e2-557c-4cfe-8041-5417e1f0ec77 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60622025-01-25T00:21:02.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b91ca2e2-557c-4cfe-8041-5417e1f0ec77 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60632025-01-25T00:21:02.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b91ca2e2-557c-4cfe-8041-5417e1f0ec77 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60642025-01-25T00:21:02.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 5691c9a2-49ed-4032-b8d2-4d7354ba7b3b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
60652025-01-25T00:21:02.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 5691c9a2-49ed-4032-b8d2-4d7354ba7b3b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
60662025-01-25T00:21:02.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3592 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 5691c9a2-49ed-4032-b8d2-4d7354ba7b3b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
60672025-01-25T00:21:02.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 28f61583-a964-44f3-b1bd-5b0c6c69505d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
60682025-01-25T00:21:02.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 28f61583-a964-44f3-b1bd-5b0c6c69505d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
60692025-01-25T00:21:02.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 28f61583-a964-44f3-b1bd-5b0c6c69505d response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
60702025-01-25T00:21:03.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 84778ed8-cb1d-46b5-b5ab-9357e02d57d6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60712025-01-25T00:21:03.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 84778ed8-cb1d-46b5-b5ab-9357e02d57d6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60722025-01-25T00:21:03.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 84778ed8-cb1d-46b5-b5ab-9357e02d57d6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60732025-01-25T00:21:04.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5c51ac2d-0cc6-4a61-af87-6bac82600c44 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60742025-01-25T00:21:04.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5c51ac2d-0cc6-4a61-af87-6bac82600c44 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60752025-01-25T00:21:04.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3637 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5c51ac2d-0cc6-4a61-af87-6bac82600c44 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60762025-01-25T00:21:05.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 806d63e8-bcde-46b0-9bfe-4cbe43d668da roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60772025-01-25T00:21:05.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 806d63e8-bcde-46b0-9bfe-4cbe43d668da resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60782025-01-25T00:21:05.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 806d63e8-bcde-46b0-9bfe-4cbe43d668da response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60792025-01-25T00:21:06.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c1ceaf5e-b958-4995-939c-049be4ed46cb roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60802025-01-25T00:21:06.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c1ceaf5e-b958-4995-939c-049be4ed46cb resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60812025-01-25T00:21:06.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c1ceaf5e-b958-4995-939c-049be4ed46cb response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60822025-01-25T00:21:07.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99bb455c-79ad-4b44-a094-74c95a77f7e0 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60832025-01-25T00:21:07.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99bb455c-79ad-4b44-a094-74c95a77f7e0 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60842025-01-25T00:21:07.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99bb455c-79ad-4b44-a094-74c95a77f7e0 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
60852025-01-25T00:21:08.420ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
60862025-01-25T00:21:08.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60872025-01-25T00:21:08.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60882025-01-25T00:21:08.421ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
60892025-01-25T00:21:08.421ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60902025-01-25T00:21:08.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60912025-01-25T00:21:08.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60922025-01-25T00:21:08.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60932025-01-25T00:21:08.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60942025-01-25T00:21:08.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60952025-01-25T00:21:08.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60962025-01-25T00:21:08.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60972025-01-25T00:21:08.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60982025-01-25T00:21:08.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
60992025-01-25T00:21:08.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61002025-01-25T00:21:08.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61012025-01-25T00:21:08.440ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
61022025-01-25T00:21:08.440ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.609452ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
61032025-01-25T00:21:08.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 83f08af3-2a28-43ec-9781-24a62f372bab roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61042025-01-25T00:21:08.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 83f08af3-2a28-43ec-9781-24a62f372bab resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61052025-01-25T00:21:08.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 83f08af3-2a28-43ec-9781-24a62f372bab response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61062025-01-25T00:21:08.453ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61072025-01-25T00:21:08.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61082025-01-25T00:21:08.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.729818ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61092025-01-25T00:21:09.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 890d9268-32a3-4e78-8110-d40110c45230 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61102025-01-25T00:21:09.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 890d9268-32a3-4e78-8110-d40110c45230 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61112025-01-25T00:21:09.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 890d9268-32a3-4e78-8110-d40110c45230 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61122025-01-25T00:21:10.357ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c4469673-5591-441c-b548-655d11b01846 remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7c0f15c4-7560-4dc2-93d4-ea0b9baeb4d1 uri = /vmms/c4469673-5591-441c-b548-655d11b01846 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-25T00:21:10.333313514Z }
61132025-01-25T00:21:10.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7c0f15c4-7560-4dc2-93d4-ea0b9baeb4d1 roles = RoleSet { roles: {} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
61142025-01-25T00:21:10.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7c0f15c4-7560-4dc2-93d4-ea0b9baeb4d1 resource = Database result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
61152025-01-25T00:21:10.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42359 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7c0f15c4-7560-4dc2-93d4-ea0b9baeb4d1 response_code = 204 uri = /vmms/c4469673-5591-441c-b548-655d11b01846
61162025-01-25T00:21:10.377ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c4469673-5591-441c-b548-655d11b01846 remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e3d1798a-5b67-48f2-8a89-d77bda263b7e uri = /vmms/c4469673-5591-441c-b548-655d11b01846 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-25T00:21:10.377005742Z }
61172025-01-25T00:21:10.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e3d1798a-5b67-48f2-8a89-d77bda263b7e roles = RoleSet { roles: {} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
61182025-01-25T00:21:10.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e3d1798a-5b67-48f2-8a89-d77bda263b7e resource = Database result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
61192025-01-25T00:21:10.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43048 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e3d1798a-5b67-48f2-8a89-d77bda263b7e response_code = 204 uri = /vmms/c4469673-5591-441c-b548-655d11b01846
61202025-01-25T00:21:10.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b2f44d0b-72c9-494b-9e42-9a6a010922f5 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61212025-01-25T00:21:10.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b2f44d0b-72c9-494b-9e42-9a6a010922f5 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61222025-01-25T00:21:10.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b2f44d0b-72c9-494b-9e42-9a6a010922f5 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61232025-01-25T00:21:10.985ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 626 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = ae422f53-e9f2-4305-b31d-8b964f10252e response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
61242025-01-25T00:21:11.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ea9e6324-28fb-4fc6-950b-b16243efa75c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61252025-01-25T00:21:11.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ea9e6324-28fb-4fc6-950b-b16243efa75c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61262025-01-25T00:21:11.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ea9e6324-28fb-4fc6-950b-b16243efa75c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61272025-01-25T00:21:12.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d34e1b78-7e99-4bf7-834f-4a2f77f23f78 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61282025-01-25T00:21:12.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d34e1b78-7e99-4bf7-834f-4a2f77f23f78 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61292025-01-25T00:21:12.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d34e1b78-7e99-4bf7-834f-4a2f77f23f78 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61302025-01-25T00:21:13.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = da0dc08a-3f80-4e8d-84fd-820e712a495e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61312025-01-25T00:21:13.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = da0dc08a-3f80-4e8d-84fd-820e712a495e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61322025-01-25T00:21:13.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = da0dc08a-3f80-4e8d-84fd-820e712a495e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61332025-01-25T00:21:14.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a6d75c4d-f348-4c60-8ce4-b5bc4b6f7d45 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61342025-01-25T00:21:14.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a6d75c4d-f348-4c60-8ce4-b5bc4b6f7d45 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61352025-01-25T00:21:14.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a6d75c4d-f348-4c60-8ce4-b5bc4b6f7d45 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61362025-01-25T00:21:15.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6e6ae370-bbb9-464a-87b2-986ae8290723 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61372025-01-25T00:21:15.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6e6ae370-bbb9-464a-87b2-986ae8290723 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61382025-01-25T00:21:15.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6e6ae370-bbb9-464a-87b2-986ae8290723 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61392025-01-25T00:21:16.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fb2ee71c-b57e-459c-b95e-9ca061c2c461 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61402025-01-25T00:21:16.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fb2ee71c-b57e-459c-b95e-9ca061c2c461 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61412025-01-25T00:21:16.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fb2ee71c-b57e-459c-b95e-9ca061c2c461 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61422025-01-25T00:21:17.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e291450d-17f9-44f9-a9a2-1e4eb902c745 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61432025-01-25T00:21:17.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e291450d-17f9-44f9-a9a2-1e4eb902c745 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61442025-01-25T00:21:17.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e291450d-17f9-44f9-a9a2-1e4eb902c745 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
61452025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
61462025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61472025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61482025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
61492025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
61502025-01-25T00:21:18.421ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2
61512025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
61522025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.42\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2"}
61532025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61542025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
61552025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
61562025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61572025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61582025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
61592025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
61602025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
61612025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61622025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61632025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
61642025-01-25T00:21:18.421ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
61652025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61662025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
61672025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
61682025-01-25T00:21:18.421ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-25 00:11:18.421779500 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61692025-01-25T00:21:18.421ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61702025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
61712025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
61722025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
61732025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
61742025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61752025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
61762025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61772025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
61782025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61792025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61802025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
61812025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61822025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
61832025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61842025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61852025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
61862025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61872025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
61882025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61892025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
61902025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
61912025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
61922025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61932025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
61942025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61952025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
61962025-01-25T00:21:18.422ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61972025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61982025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61992025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
62002025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
62012025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62022025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62032025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
62042025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62052025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
62062025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
62072025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62082025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62092025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62102025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62112025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62122025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62132025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62142025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62152025-01-25T00:21:18.422ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22685765-7656-499f-8835-1c19f38e16e6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1601, tv_nsec: 141054920 } })
62162025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62172025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62182025-01-25T00:21:18.422ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("167a4f68-f407-48e5-a9a6-22f96a22bf2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3a6aa3c-ea79-4881-9aa5-b12ba496f837.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1601, tv_nsec: 141097230 } })
62192025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62202025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62212025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62222025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62232025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
62242025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62252025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62262025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62272025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62282025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62292025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62302025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62312025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62322025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62332025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62342025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62352025-01-25T00:21:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62362025-01-25T00:21:18.423ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
62372025-01-25T00:21:18.423ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.203477ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
62382025-01-25T00:21:18.423ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
62392025-01-25T00:21:18.423ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.368627ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
62402025-01-25T00:21:18.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62412025-01-25T00:21:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62422025-01-25T00:21:18.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62432025-01-25T00:21:18.425ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62442025-01-25T00:21:18.426ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.246762ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62452025-01-25T00:21:18.426ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1601, tv_nsec: 144933790 } })
62462025-01-25T00:21:18.426ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62472025-01-25T00:21:18.426ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
62482025-01-25T00:21:18.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62492025-01-25T00:21:18.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62502025-01-25T00:21:18.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62512025-01-25T00:21:18.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
62522025-01-25T00:21:18.427ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62532025-01-25T00:21:18.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62542025-01-25T00:21:18.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62552025-01-25T00:21:18.429ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62562025-01-25T00:21:18.429ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-25 00:11:18.421779500 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62572025-01-25T00:21:18.429ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.868131ms iteration = 12 status = {"expiration":"2025-01-25T00:11:18.421779500Z","pruned":[]}
62582025-01-25T00:21:18.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62592025-01-25T00:21:18.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62602025-01-25T00:21:18.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62612025-01-25T00:21:18.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62622025-01-25T00:21:18.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62632025-01-25T00:21:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62642025-01-25T00:21:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62652025-01-25T00:21:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62662025-01-25T00:21:18.431ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62672025-01-25T00:21:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62682025-01-25T00:21:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62692025-01-25T00:21:18.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62702025-01-25T00:21:18.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62712025-01-25T00:21:18.433ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62722025-01-25T00:21:18.434ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.245154ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
62732025-01-25T00:21:18.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62742025-01-25T00:21:18.435ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1601, tv_nsec: 153652485 } })
62752025-01-25T00:21:18.435ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
62762025-01-25T00:21:18.435ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62772025-01-25T00:21:18.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62782025-01-25T00:21:18.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62792025-01-25T00:21:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62802025-01-25T00:21:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62812025-01-25T00:21:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62822025-01-25T00:21:18.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62832025-01-25T00:21:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62842025-01-25T00:21:18.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62852025-01-25T00:21:18.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62862025-01-25T00:21:18.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62872025-01-25T00:21:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62882025-01-25T00:21:18.441ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
62892025-01-25T00:21:18.441ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
62902025-01-25T00:21:18.441ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 19.11244ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
62912025-01-25T00:21:18.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62922025-01-25T00:21:18.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.190835ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
62932025-01-25T00:21:18.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62942025-01-25T00:21:18.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62952025-01-25T00:21:18.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62962025-01-25T00:21:18.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62972025-01-25T00:21:18.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62982025-01-25T00:21:18.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62992025-01-25T00:21:18.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63002025-01-25T00:21:18.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 35.659566ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63012025-01-25T00:21:18.458ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63022025-01-25T00:21:18.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63032025-01-25T00:21:18.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.704256ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63042025-01-25T00:21:18.465ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63052025-01-25T00:21:18.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63062025-01-25T00:21:18.468ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63072025-01-25T00:21:18.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63082025-01-25T00:21:18.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63092025-01-25T00:21:18.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
63102025-01-25T00:21:18.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63112025-01-25T00:21:18.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63122025-01-25T00:21:18.476ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1601, tv_nsec: 195442133 } })
63132025-01-25T00:21:18.477ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
63142025-01-25T00:21:18.492ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 70.613348ms iteration = 26 status = {"physical_disks_added":0}
63152025-01-25T00:21:18.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.922415ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
63162025-01-25T00:21:18.496ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
63172025-01-25T00:21:18.496ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.809359ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
63182025-01-25T00:21:18.502ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63192025-01-25T00:21:18.502ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63202025-01-25T00:21:18.502ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63212025-01-25T00:21:18.502ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63222025-01-25T00:21:18.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63232025-01-25T00:21:18.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63242025-01-25T00:21:18.507ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63252025-01-25T00:21:18.507ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63262025-01-25T00:21:18.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63272025-01-25T00:21:18.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63282025-01-25T00:21:18.508ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63292025-01-25T00:21:18.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63302025-01-25T00:21:18.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63312025-01-25T00:21:18.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63322025-01-25T00:21:18.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63332025-01-25T00:21:18.514ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63342025-01-25T00:21:18.514ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63352025-01-25T00:21:18.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63362025-01-25T00:21:18.514ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63372025-01-25T00:21:18.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63382025-01-25T00:21:18.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63392025-01-25T00:21:18.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63402025-01-25T00:21:18.520ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63412025-01-25T00:21:18.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63422025-01-25T00:21:18.522ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63432025-01-25T00:21:18.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63442025-01-25T00:21:18.523ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
63452025-01-25T00:21:18.523ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
63462025-01-25T00:21:18.523ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
63472025-01-25T00:21:18.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63482025-01-25T00:21:18.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
63492025-01-25T00:21:18.523ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63502025-01-25T00:21:18.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63512025-01-25T00:21:18.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63522025-01-25T00:21:18.525ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63532025-01-25T00:21:18.525ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
63542025-01-25T00:21:18.525ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.570249ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63552025-01-25T00:21:18.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
63562025-01-25T00:21:18.525ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63572025-01-25T00:21:18.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63582025-01-25T00:21:18.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63592025-01-25T00:21:18.527ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63602025-01-25T00:21:18.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63612025-01-25T00:21:18.529ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.391179ms iteration = 23 status = 0
63622025-01-25T00:21:18.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63632025-01-25T00:21:18.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63642025-01-25T00:21:18.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63652025-01-25T00:21:18.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63662025-01-25T00:21:18.532ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63672025-01-25T00:21:18.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63682025-01-25T00:21:18.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63692025-01-25T00:21:18.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63702025-01-25T00:21:18.534ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63712025-01-25T00:21:18.534ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63722025-01-25T00:21:18.534ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63732025-01-25T00:21:18.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63742025-01-25T00:21:18.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63752025-01-25T00:21:18.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63762025-01-25T00:21:18.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63772025-01-25T00:21:18.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63782025-01-25T00:21:18.545ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63792025-01-25T00:21:18.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63802025-01-25T00:21:18.548ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
63812025-01-25T00:21:18.548ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 0 version = 2
63822025-01-25T00:21:18.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63832025-01-25T00:21:18.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63842025-01-25T00:21:18.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63852025-01-25T00:21:18.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63862025-01-25T00:21:18.561ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63872025-01-25T00:21:18.561ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63882025-01-25T00:21:18.561ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 139.691077ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63892025-01-25T00:21:18.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63902025-01-25T00:21:18.566ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63912025-01-25T00:21:18.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
63922025-01-25T00:21:18.568ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63932025-01-25T00:21:18.568ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63942025-01-25T00:21:18.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63952025-01-25T00:21:18.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 149.911721ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63962025-01-25T00:21:18.578ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
63972025-01-25T00:21:18.578ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63982025-01-25T00:21:18.579ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d3e7749-87b4-4571-b0e0-174f14906ec9", "content-length": "26", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
63992025-01-25T00:21:18.579ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64002025-01-25T00:21:18.579ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
64012025-01-25T00:21:18.579ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 158.270515ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
64022025-01-25T00:21:18.581ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64032025-01-25T00:21:18.592ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
64042025-01-25T00:21:18.592ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64052025-01-25T00:21:18.592ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6de7ca6e-ad01-46f8-be61-5e36ab400be5", "content-length": "26", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
64062025-01-25T00:21:18.592ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64072025-01-25T00:21:18.593ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64082025-01-25T00:21:18.646ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
64092025-01-25T00:21:18.646ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64102025-01-25T00:21:18.647ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "006b047b-2dc3-4808-8f62-11fe6042ef37", "content-length": "26", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
64112025-01-25T00:21:18.647ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64122025-01-25T00:21:18.648ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
64132025-01-25T00:21:18.659ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64142025-01-25T00:21:18.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64152025-01-25T00:21:18.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64162025-01-25T00:21:18.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3d67da22-bdd0-4786-9d06-9c2cd70e598b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
64172025-01-25T00:21:18.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3d67da22-bdd0-4786-9d06-9c2cd70e598b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
64182025-01-25T00:21:18.680ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/c4469673-5591-441c-b548-655d11b01846/state
64192025-01-25T00:21:18.680ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/c4469673-5591-441c-b548-655d11b01846/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba06e5ab-b8b7-483d-a8bb-05f4fba6f092", "content-length": "130", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
64202025-01-25T00:21:18.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64212025-01-25T00:21:18.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64222025-01-25T00:21:18.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64232025-01-25T00:21:18.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64242025-01-25T00:21:18.685ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 sled_id = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-25T00:21:10.377005742Z }, migration_in: None, migration_out: None } vmm_id = c4469673-5591-441c-b548-655d11b01846
64252025-01-25T00:21:18.685ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2078 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c4469673-5591-441c-b548-655d11b01846 sled_id = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 vmm_id = c4469673-5591-441c-b548-655d11b01846 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-25T00:21:10.377005742Z }
64262025-01-25T00:21:18.685ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 roles = RoleSet { roles: {} } sled_id = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 vmm_id = c4469673-5591-441c-b548-655d11b01846
64272025-01-25T00:21:18.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 resource = Database result = Ok(()) sled_id = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 vmm_id = c4469673-5591-441c-b548-655d11b01846
64282025-01-25T00:21:18.687ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64292025-01-25T00:21:18.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 13487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3d67da22-bdd0-4786-9d06-9c2cd70e598b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
64302025-01-25T00:21:18.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64312025-01-25T00:21:18.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64322025-01-25T00:21:18.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64332025-01-25T00:21:18.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64342025-01-25T00:21:18.718ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 296.125602ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
64352025-01-25T00:21:18.719ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
64362025-01-25T00:21:18.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64372025-01-25T00:21:18.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64382025-01-25T00:21:18.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64392025-01-25T00:21:18.721ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-25T00:10:16.530962Z, time_modified: 2025-01-25T00:10:16.530962Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
64402025-01-25T00:21:18.722ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 300.144803ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]}},"default_endpoint":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64412025-01-25T00:21:18.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64422025-01-25T00:21:18.722ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 1 version = 2
64432025-01-25T00:21:18.722ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
64442025-01-25T00:21:18.722ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-25 00:10:47.835608 UTC dns_group = external generation = 2
64452025-01-25T00:21:18.722ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 300.983797ms iteration = 12 status = {"generation":2}
64462025-01-25T00:21:18.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64472025-01-25T00:21:18.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64482025-01-25T00:21:18.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64492025-01-25T00:21:18.726ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
64502025-01-25T00:21:18.726ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
64512025-01-25T00:21:18.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64522025-01-25T00:21:18.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64532025-01-25T00:21:18.727ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
64542025-01-25T00:21:18.729ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 307.349881ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
64552025-01-25T00:21:18.743ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 321.492635ms iteration = 23 status = {}
64562025-01-25T00:21:18.748ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64572025-01-25T00:21:18.748ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "98563458-2b11-438d-b15a-5d55600918a0", "content-length": "1", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
64582025-01-25T00:21:18.750ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64592025-01-25T00:21:18.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64602025-01-25T00:21:18.753ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 332.250541ms iteration = 23 status = null
64612025-01-25T00:21:18.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64622025-01-25T00:21:18.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64632025-01-25T00:21:18.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64642025-01-25T00:21:18.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64652025-01-25T00:21:18.767ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
64662025-01-25T00:21:18.767ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64672025-01-25T00:21:18.767ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-25 00:10:46.879674 UTC dns_group = internal generation = 1
64682025-01-25T00:21:18.767ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 345.71148ms iteration = 12 status = {"generation":1}
64692025-01-25T00:21:18.795ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
64702025-01-25T00:21:18.795ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 373.204833ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
64712025-01-25T00:21:18.896ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64722025-01-25T00:21:18.896ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64732025-01-25T00:21:18.897ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bea6c78-8bf4-4f03-98e9-52fd5ffcd9bf", "content-length": "583", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
64742025-01-25T00:21:18.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64752025-01-25T00:21:18.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64762025-01-25T00:21:18.926ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
64772025-01-25T00:21:18.927ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a4bb38b1-669b-4122-978c-4c3b73405c5c", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64782025-01-25T00:21:18.927ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64792025-01-25T00:21:18.929ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fa29dfe6-04c0-4bcf-a066-2ac31abcdfca", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64802025-01-25T00:21:18.929ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64812025-01-25T00:21:18.929ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
64822025-01-25T00:21:18.931ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64832025-01-25T00:21:18.931ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 509.332132ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
64842025-01-25T00:21:18.942ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64852025-01-25T00:21:18.942ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "779c2468-7d18-4d91-83d5-4d062f895888", "content-length": "810", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
64862025-01-25T00:21:18.942ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(2357796) }} sled = buskin
64872025-01-25T00:21:18.942ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
64882025-01-25T00:21:18.942ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
64892025-01-25T00:21:18.944ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 522.214768ms iteration = 23 status = {}
64902025-01-25T00:21:18.955ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {137a3e71-078c-410e-aa4f-4b521683d898: {10.151.1.175: {b6b76b23-46d8-4cf4-8ef8-06ebb296975d}, 10.151.1.176: {b6b76b23-46d8-4cf4-8ef8-06ebb296975d}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
64912025-01-25T00:21:18.955ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64922025-01-25T00:21:18.955ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "85c83780-4793-47de-9170-32ef70078f81", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
64932025-01-25T00:21:18.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64942025-01-25T00:21:18.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64952025-01-25T00:21:18.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64962025-01-25T00:21:18.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64972025-01-25T00:21:18.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64982025-01-25T00:21:18.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64992025-01-25T00:21:18.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65002025-01-25T00:21:18.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65012025-01-25T00:21:18.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65022025-01-25T00:21:18.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65032025-01-25T00:21:18.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65042025-01-25T00:21:18.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65052025-01-25T00:21:18.972ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
65062025-01-25T00:21:18.972ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
65072025-01-25T00:21:18.972ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65082025-01-25T00:21:18.973ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "84e4f447-88b1-4fe8-8748-9f727c302f12", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
65092025-01-25T00:21:18.975ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 553.16694ms iteration = 23 status = {}
65102025-01-25T00:21:18.982ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
65112025-01-25T00:21:18.982ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "252293a8-1e79-4598-a349-5e7d20ea1294", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65122025-01-25T00:21:18.982ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65132025-01-25T00:21:18.985ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "64025770-4910-4c89-b64f-618bcdf722a2", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65142025-01-25T00:21:18.985ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65152025-01-25T00:21:18.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65162025-01-25T00:21:18.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65172025-01-25T00:21:18.987ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8bf4f265-a23e-45fc-a140-7ae11d46dc1a", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65182025-01-25T00:21:18.987ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65192025-01-25T00:21:18.988ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
65202025-01-25T00:21:18.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65212025-01-25T00:21:18.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65222025-01-25T00:21:18.989ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
65232025-01-25T00:21:18.989ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 567.977878ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
65242025-01-25T00:21:18.997ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65252025-01-25T00:21:18.997ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b87336f-9cd0-4709-a6e0-a2c2c005b428", "content-length": "134", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
65262025-01-25T00:21:18.998ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
65272025-01-25T00:21:18.998ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
65282025-01-25T00:21:18.998ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65292025-01-25T00:21:18.998ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65302025-01-25T00:21:18.998ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65312025-01-25T00:21:18.998ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65322025-01-25T00:21:18.998ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65332025-01-25T00:21:18.998ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65342025-01-25T00:21:18.998ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65352025-01-25T00:21:18.998ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65362025-01-25T00:21:18.998ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
65372025-01-25T00:21:18.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65382025-01-25T00:21:18.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65392025-01-25T00:21:19.001ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65402025-01-25T00:21:19.001ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "73ee1258-1233-4e0b-8d12-aba76f196ac6", "content-length": "2", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
65412025-01-25T00:21:19.001ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65422025-01-25T00:21:19.001ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c622ed4c-053f-46e7-a233-34b2b6564bbf", "content-length": "52", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
65432025-01-25T00:21:19.001ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
65442025-01-25T00:21:19.001ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65452025-01-25T00:21:19.179ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ca200707-1d7f-4337-915e-07632cf27d47", "date": "Sat, 25 Jan 2025 00:21:18 GMT"} })
65462025-01-25T00:21:19.179ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
65472025-01-25T00:21:19.179ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65482025-01-25T00:21:19.180ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb479ec2-f30a-4318-8a57-ceb6c1715699", "content-length": "682", "date": "Sat, 25 Jan 2025 00:21:19 GMT"} })
65492025-01-25T00:21:19.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65502025-01-25T00:21:19.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65512025-01-25T00:21:19.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65522025-01-25T00:21:19.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65532025-01-25T00:21:19.191ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65542025-01-25T00:21:19.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65552025-01-25T00:21:19.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65562025-01-25T00:21:19.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65572025-01-25T00:21:19.203ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 781.152128ms iteration = 23 status = {}
65582025-01-25T00:21:19.303ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
65592025-01-25T00:21:19.303ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
65602025-01-25T00:21:19.334ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
65612025-01-25T00:21:19.334ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:34541
65622025-01-25T00:21:19.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34541 req_id = 90c58d17-631b-4e74-9f7e-da2745f25ee8 roles = RoleSet { roles: {} } uri = /metrics/producers
65632025-01-25T00:21:19.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34541 req_id = 90c58d17-631b-4e74-9f7e-da2745f25ee8 resource = Database result = Ok(()) uri = /metrics/producers
65642025-01-25T00:21:19.372ZINFOnexus: assigned collector to new producer collector_id = 512ae8cc-0c00-4148-bad7-ae5dd7be4169 file = nexus/src/app/oximeter.rs:76 producer_id = af353237-4651-4023-8604-ee309f64048e
65652025-01-25T00:21:19.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37972 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34541 req_id = 90c58d17-631b-4e74-9f7e-da2745f25ee8 response_code = 201 uri = /metrics/producers
65662025-01-25T00:21:19.372ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "90c58d17-631b-4e74-9f7e-da2745f25ee8", "content-length": "41", "date": "Sat, 25 Jan 2025 00:21:19 GMT"} })
65672025-01-25T00:21:19.374ZDEBGnexus (producer-registration-task): registered with nexus successfully
65682025-01-25T00:21:19.374ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
65692025-01-25T00:21:19.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bdd62a2b-82b2-4033-b2ba-fcfbbb38d356 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65702025-01-25T00:21:19.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bdd62a2b-82b2-4033-b2ba-fcfbbb38d356 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65712025-01-25T00:21:19.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2643 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bdd62a2b-82b2-4033-b2ba-fcfbbb38d356 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65722025-01-25T00:21:20.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b602eeb1-3038-4c0b-ae5f-11e0492feec6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65732025-01-25T00:21:20.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b602eeb1-3038-4c0b-ae5f-11e0492feec6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65742025-01-25T00:21:20.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b602eeb1-3038-4c0b-ae5f-11e0492feec6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65752025-01-25T00:21:20.912ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c4469673-5591-441c-b548-655d11b01846 remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 090bef3b-a7a4-4bc2-b0ae-e4d1053a7d04 uri = /vmms/c4469673-5591-441c-b548-655d11b01846 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-25T00:21:20.912245537Z }
65762025-01-25T00:21:20.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 090bef3b-a7a4-4bc2-b0ae-e4d1053a7d04 roles = RoleSet { roles: {} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
65772025-01-25T00:21:20.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 090bef3b-a7a4-4bc2-b0ae-e4d1053a7d04 resource = Database result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
65782025-01-25T00:21:20.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8073 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 090bef3b-a7a4-4bc2-b0ae-e4d1053a7d04 response_code = 204 uri = /vmms/c4469673-5591-441c-b548-655d11b01846
65792025-01-25T00:21:20.990ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5388 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 01f8fe98-972f-49dd-a206-eb0c27347a00 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
65802025-01-25T00:21:21.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 427b5828-aef4-4c09-89f7-7dd8b48547d2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65812025-01-25T00:21:21.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 427b5828-aef4-4c09-89f7-7dd8b48547d2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65822025-01-25T00:21:21.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = cbfc92fe-6a8f-4e46-9b2c-c8514e6af3ed roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
65832025-01-25T00:21:21.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = cbfc92fe-6a8f-4e46-9b2c-c8514e6af3ed resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
65842025-01-25T00:21:21.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 427b5828-aef4-4c09-89f7-7dd8b48547d2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65852025-01-25T00:21:21.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = cbfc92fe-6a8f-4e46-9b2c-c8514e6af3ed response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
65862025-01-25T00:21:21.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = a6172d04-8724-47df-810c-3f17f518e622 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
65872025-01-25T00:21:21.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = a6172d04-8724-47df-810c-3f17f518e622 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
65882025-01-25T00:21:21.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = a6172d04-8724-47df-810c-3f17f518e622 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
65892025-01-25T00:21:22.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 8a90f9cc-dc48-436c-9719-dd3386ac2898 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
65902025-01-25T00:21:22.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 8a90f9cc-dc48-436c-9719-dd3386ac2898 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
65912025-01-25T00:21:22.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 8a90f9cc-dc48-436c-9719-dd3386ac2898 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
65922025-01-25T00:21:22.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2172ace4-d696-4feb-ac5b-bc3e03a9d7b8 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65932025-01-25T00:21:22.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2172ace4-d696-4feb-ac5b-bc3e03a9d7b8 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65942025-01-25T00:21:22.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2172ace4-d696-4feb-ac5b-bc3e03a9d7b8 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
65952025-01-25T00:21:23.354ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c4469673-5591-441c-b548-655d11b01846 remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 uri = /vmms/c4469673-5591-441c-b548-655d11b01846 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-25T00:21:23.353817971Z }
65962025-01-25T00:21:23.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 roles = RoleSet { roles: {} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
65972025-01-25T00:21:23.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 resource = Database result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
65982025-01-25T00:21:23.367ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = c4469673-5591-441c-b548-655d11b01846 remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 uri = /vmms/c4469673-5591-441c-b548-655d11b01846 vmm_needs_update = true
65992025-01-25T00:21:23.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 roles = RoleSet { roles: {} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66002025-01-25T00:21:23.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 resource = Database result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66012025-01-25T00:21:23.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 roles = RoleSet { roles: {} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66022025-01-25T00:21:23.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 resource = Database result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66032025-01-25T00:21:23.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 roles = RoleSet { roles: {} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66042025-01-25T00:21:23.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 resource = Database result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66052025-01-25T00:21:23.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 roles = RoleSet { roles: {} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66062025-01-25T00:21:23.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 resource = Database result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66072025-01-25T00:21:23.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 roles = RoleSet { roles: {} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66082025-01-25T00:21:23.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 resource = Database result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66092025-01-25T00:21:23.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 roles = RoleSet { roles: {} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66102025-01-25T00:21:23.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 resource = Database result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66112025-01-25T00:21:23.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66122025-01-25T00:21:23.415ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fd047cff-047f-41d5-9f37-bd6037bf08d8, lookup_type: ById(fd047cff-047f-41d5-9f37-bd6037bf08d8) }, key: 3744141e-2339-4876-b994-4d29dab4c911, lookup_type: ById(3744141e-2339-4876-b994-4d29dab4c911) }, key: 64f0f24b-50b9-47de-b30b-f05ec584db12, lookup_type: ById(64f0f24b-50b9-47de-b30b-f05ec584db12) } result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66132025-01-25T00:21:23.428ZINFOnexus (dropshot_internal): starting update saga for 64f0f24b-50b9-47de-b30b-f05ec584db12 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1545 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 uri = /vmms/c4469673-5591-441c-b548-655d11b01846 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-25T00:21:23.353817971Z }
66142025-01-25T00:21:23.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78893 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 response_code = 204 uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66152025-01-25T00:21:23.432ZDEBGnexus (dropshot_internal): preparing instance-update saga for 64f0f24b-50b9-47de-b30b-f05ec584db12... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0bf34264-538e-40f8-9705-5df19ec3d5e6 uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66162025-01-25T00:21:23.432ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update
66172025-01-25T00:21:23.433ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2078 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c4469673-5591-441c-b548-655d11b01846 remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 261b6254-8fd1-481e-9929-5dda0c9ca154 uri = /vmms/c4469673-5591-441c-b548-655d11b01846 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-25T00:21:23.353817971Z }
66182025-01-25T00:21:23.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 261b6254-8fd1-481e-9929-5dda0c9ca154 roles = RoleSet { roles: {} } uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66192025-01-25T00:21:23.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 261b6254-8fd1-481e-9929-5dda0c9ca154 resource = Database result = Ok(()) uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66202025-01-25T00:21:23.438ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"64f0f24b-50b9-47de-b30b-f05ec584db12","lookup_type":{"ById":"64f0f24b-50b9-47de-b30b-f05ec584db12"},"parent":{"key":"3744141e-2339-4876-b994-4d29dab4c911","lookup_type":{"ById":"3744141e-2339-4876-b994-4d29dab4c911"},"parent":{"key":"fd047cff-047f-41d5-9f37-bd6037bf08d8","lookup_type":{"ById":"fd047cff-047f-41d5-9f37-bd6037bf08d8"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update sec_id = af353237-4651-4023-8604-ee309f64048e
66212025-01-25T00:21:23.438ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update
66222025-01-25T00:21:23.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35141 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 261b6254-8fd1-481e-9929-5dda0c9ca154 response_code = 204 uri = /vmms/c4469673-5591-441c-b548-655d11b01846
66232025-01-25T00:21:23.474ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update
66242025-01-25T00:21:23.474ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update sec_id = af353237-4651-4023-8604-ee309f64048e
66252025-01-25T00:21:23.476ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = af353237-4651-4023-8604-ee309f64048e
66262025-01-25T00:21:23.479ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff
66272025-01-25T00:21:23.490ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
66282025-01-25T00:21:23.490ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff
66292025-01-25T00:21:23.499ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = af353237-4651-4023-8604-ee309f64048e
66302025-01-25T00:21:23.499ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff
66312025-01-25T00:21:23.512ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
66322025-01-25T00:21:23.512ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("bd142724-00ce-46d4-8059-f12bba4dad67")) node_id = 0 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff
66332025-01-25T00:21:23.517ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = af353237-4651-4023-8604-ee309f64048e
66342025-01-25T00:21:23.517ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff
66352025-01-25T00:21:23.539ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update
66362025-01-25T00:21:23.539ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66372025-01-25T00:21:23.540ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66382025-01-25T00:21:23.542ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66392025-01-25T00:21:23.542ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66402025-01-25T00:21:23.547ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66412025-01-25T00:21:23.548ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66422025-01-25T00:21:23.550ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66432025-01-25T00:21:23.550ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66442025-01-25T00:21:23.552ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66452025-01-25T00:21:23.552ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66462025-01-25T00:21:23.581ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66472025-01-25T00:21:23.582ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66482025-01-25T00:21:23.583ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66492025-01-25T00:21:23.586ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fd047cff-047f-41d5-9f37-bd6037bf08d8, lookup_type: ById(fd047cff-047f-41d5-9f37-bd6037bf08d8) }, key: 3744141e-2339-4876-b994-4d29dab4c911, lookup_type: ById(3744141e-2339-4876-b994-4d29dab4c911) }, key: 64f0f24b-50b9-47de-b30b-f05ec584db12, lookup_type: ById(64f0f24b-50b9-47de-b30b-f05ec584db12) } result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66502025-01-25T00:21:23.586ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance updater_id = bd142724-00ce-46d4-8059-f12bba4dad67
66512025-01-25T00:21:23.586ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66522025-01-25T00:21:23.586ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66532025-01-25T00:21:23.603ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance updater_id = bd142724-00ce-46d4-8059-f12bba4dad67
66542025-01-25T00:21:23.603ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66552025-01-25T00:21:23.603ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance
66562025-01-25T00:21:23.610ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 locked_gen = Generation(Generation(2)) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = LockInstance updater_id = bd142724-00ce-46d4-8059-f12bba4dad67
66572025-01-25T00:21:23.610ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
66582025-01-25T00:21:23.610ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("bd142724-00ce-46d4-8059-f12bba4dad67")}) node_id = 1 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff
66592025-01-25T00:21:23.614ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = af353237-4651-4023-8604-ee309f64048e
66602025-01-25T00:21:23.614ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff
66612025-01-25T00:21:23.620ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66622025-01-25T00:21:23.620ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66632025-01-25T00:21:23.621ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66642025-01-25T00:21:23.622ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66652025-01-25T00:21:23.623ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66662025-01-25T00:21:23.623ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66672025-01-25T00:21:23.624ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66682025-01-25T00:21:23.627ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fd047cff-047f-41d5-9f37-bd6037bf08d8, lookup_type: ById(fd047cff-047f-41d5-9f37-bd6037bf08d8) }, key: 3744141e-2339-4876-b994-4d29dab4c911, lookup_type: ById(3744141e-2339-4876-b994-4d29dab4c911) }, key: 64f0f24b-50b9-47de-b30b-f05ec584db12, lookup_type: ById(64f0f24b-50b9-47de-b30b-f05ec584db12) } result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66692025-01-25T00:21:23.627ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66702025-01-25T00:21:23.628ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
66712025-01-25T00:21:23.637ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: c4469673-5591-441c-b548-655d11b01846, time_created: 2025-01-25T00:21:02.242970Z, time_deleted: None, instance_id: 64f0f24b-50b9-47de-b30b-f05ec584db12, sled_id: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-25T00:21:23.353817Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-25T00:21:00.150266Z, gen: Generation(Generation(3)), propolis_id: Some(c4469673-5591-441c-b548-655d11b01846), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(c4469673-5591-441c-b548-655d11b01846 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-25T00:21:23.637379087Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
66722025-01-25T00:21:23.637ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
66732025-01-25T00:21:23.637ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"64f0f24b-50b9-47de-b30b-f05ec584db12","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"c4469673-5591-441c-b548-655d11b01846"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"64f0f24b-50b9-47de-b30b-f05ec584db12","lookup_type":{"ById":"64f0f24b-50b9-47de-b30b-f05ec584db12"},"parent":{"key":"3744141e-2339-4876-b994-4d29dab4c911","lookup_type":{"ById":"3744141e-2339-4876-b994-4d29dab4c911"},"parent":{"key":"fd047cff-047f-41d5-9f37-bd6037bf08d8","lookup_type":{"ById":"fd047cff-047f-41d5-9f37-bd6037bf08d8"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"bd142724-00ce-46d4-8059-f12bba4dad67"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"3744141e-2339-4876-b994-4d29dab4c911","ram_diff":1073741824},"destroy_active_vmm":"c4469673-5591-441c-b548-655d11b01846","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-25T00:21:23.637379087Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update sec_id = af353237-4651-4023-8604-ee309f64048e
66742025-01-25T00:21:23.637ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
66752025-01-25T00:21:23.642ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
66762025-01-25T00:21:23.642ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update sec_id = af353237-4651-4023-8604-ee309f64048e
66772025-01-25T00:21:23.642ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = af353237-4651-4023-8604-ee309f64048e
66782025-01-25T00:21:23.642ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
66792025-01-25T00:21:23.645ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
66802025-01-25T00:21:23.645ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
66812025-01-25T00:21:23.648ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = af353237-4651-4023-8604-ee309f64048e
66822025-01-25T00:21:23.648ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
66832025-01-25T00:21:23.651ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
66842025-01-25T00:21:23.651ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("25c2e8f2-6e98-483a-adb3-d295dbfa731e")) node_id = 0 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
66852025-01-25T00:21:23.654ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = af353237-4651-4023-8604-ee309f64048e
66862025-01-25T00:21:23.654ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
66872025-01-25T00:21:23.661ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 parent_lock = UpdaterLock { updater_id: bd142724-00ce-46d4-8059-f12bba4dad67, locked_gen: Generation(Generation(2)) } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
66882025-01-25T00:21:23.661ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = BecomeUpdater
66892025-01-25T00:21:23.661ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = BecomeUpdater
66902025-01-25T00:21:23.669ZDEBGnexus (SagaExecutor): inherited lock from bd142724-00ce-46d4-8059-f12bba4dad67 to 25c2e8f2-6e98-483a-adb3-d295dbfa731e actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = bd142724-00ce-46d4-8059-f12bba4dad67 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = BecomeUpdater updater_id = 25c2e8f2-6e98-483a-adb3-d295dbfa731e
66912025-01-25T00:21:23.669ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
66922025-01-25T00:21:23.669ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
66932025-01-25T00:21:23.669ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("25c2e8f2-6e98-483a-adb3-d295dbfa731e")}) node_id = 1 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
66942025-01-25T00:21:23.672ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = af353237-4651-4023-8604-ee309f64048e
66952025-01-25T00:21:23.672ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
66962025-01-25T00:21:23.674ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
66972025-01-25T00:21:23.674ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
66982025-01-25T00:21:23.677ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = af353237-4651-4023-8604-ee309f64048e
66992025-01-25T00:21:23.677ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67002025-01-25T00:21:23.683ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
67012025-01-25T00:21:23.683ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12
67022025-01-25T00:21:23.685ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = UpdateNetworkConfig
67032025-01-25T00:21:23.685ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = UpdateNetworkConfig
67042025-01-25T00:21:23.698ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = UpdateNetworkConfig
67052025-01-25T00:21:23.698ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = UpdateNetworkConfig
67062025-01-25T00:21:23.703ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
67072025-01-25T00:21:23.703ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = UpdateNetworkConfig
67082025-01-25T00:21:23.703ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = UpdateNetworkConfig
67092025-01-25T00:21:23.705ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
67102025-01-25T00:21:23.705ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
67112025-01-25T00:21:23.705ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
67122025-01-25T00:21:23.707ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
67132025-01-25T00:21:23.708ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
67142025-01-25T00:21:23.708ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
67152025-01-25T00:21:23.708ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
67162025-01-25T00:21:23.712ZDEBGnexus: notifying dendrite of updates instance_id = Some(64f0f24b-50b9-47de-b30b-f05ec584db12 (instance)) switch = switch0
67172025-01-25T00:21:23.712ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1606, tv_nsec: 431242136 } })
67182025-01-25T00:21:23.713ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1139
67192025-01-25T00:21:23.743ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
67202025-01-25T00:21:23.743ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67212025-01-25T00:21:23.743ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5375db0-a604-4f00-8ce2-4f31fc08e079", "content-length": "26", "date": "Sat, 25 Jan 2025 00:21:23 GMT"} })
67222025-01-25T00:21:23.743ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67232025-01-25T00:21:23.744ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67242025-01-25T00:21:23.773ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
67252025-01-25T00:21:23.773ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f18bb9d-f4da-4fa8-b979-cfdba923f31a", "content-length": "4", "date": "Sat, 25 Jan 2025 00:21:23 GMT"} })
67262025-01-25T00:21:23.774ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
67272025-01-25T00:21:23.774ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67282025-01-25T00:21:23.777ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = af353237-4651-4023-8604-ee309f64048e
67292025-01-25T00:21:23.777ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67302025-01-25T00:21:23.786ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
67312025-01-25T00:21:23.786ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
67322025-01-25T00:21:23.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7e03c688-ad7c-4d66-bf50-232dbe446d73 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
67332025-01-25T00:21:23.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7e03c688-ad7c-4d66-bf50-232dbe446d73 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
67342025-01-25T00:21:23.806ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-25T00:21:23.797355Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 3744141e-2339-4876-b994-4d29dab4c911, time_modified: Some(2025-01-25T00:21:23.797355Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, time_modified: Some(2025-01-25T00:21:23.797355Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
67352025-01-25T00:21:23.806ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
67362025-01-25T00:21:23.806ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67372025-01-25T00:21:23.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7e03c688-ad7c-4d66-bf50-232dbe446d73 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
67382025-01-25T00:21:23.809ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = af353237-4651-4023-8604-ee309f64048e
67392025-01-25T00:21:23.809ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67402025-01-25T00:21:23.813ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
67412025-01-25T00:21:23.813ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = UnassignOximeterProducer
67422025-01-25T00:21:23.814ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = UnassignOximeterProducer
67432025-01-25T00:21:23.821ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 512ae8cc-0c00-4148-bad7-ae5dd7be4169 producer_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
67442025-01-25T00:21:23.821ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = UnassignOximeterProducer
67452025-01-25T00:21:23.821ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = UnassignOximeterProducer
67462025-01-25T00:21:23.855ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
67472025-01-25T00:21:23.858ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/64f0f24b-50b9-47de-b30b-f05ec584db12
67482025-01-25T00:21:23.882ZDEBGnexus (SagaExecutor): client response oximeter-collector = 64f0f24b-50b9-47de-b30b-f05ec584db12 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/64f0f24b-50b9-47de-b30b-f05ec584db12", status: 204, headers: {"x-request-id": "8028bc4f-3463-4306-ac0c-7e9630ada9e3", "date": "Sat, 25 Jan 2025 00:21:23 GMT"} }) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
67492025-01-25T00:21:23.882ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 512ae8cc-0c00-4148-bad7-ae5dd7be4169 producer_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
67502025-01-25T00:21:23.884ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
67512025-01-25T00:21:23.884ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67522025-01-25T00:21:23.889ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = af353237-4651-4023-8604-ee309f64048e
67532025-01-25T00:21:23.889ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67542025-01-25T00:21:23.893ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 lock = UpdaterLock { updater_id: 25c2e8f2-6e98-483a-adb3-d295dbfa731e, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-25T00:21:23.637379087Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
67552025-01-25T00:21:23.893ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = CommitInstanceUpdates
67562025-01-25T00:21:23.893ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = CommitInstanceUpdates
67572025-01-25T00:21:23.980ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 new_runtime = InstanceRuntimeState { time_updated: 2025-01-25T00:21:23.637379087Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
67582025-01-25T00:21:23.980ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
67592025-01-25T00:21:23.980ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67602025-01-25T00:21:23.980ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
67612025-01-25T00:21:23.980ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
67622025-01-25T00:21:23.980ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67632025-01-25T00:21:23.980ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67642025-01-25T00:21:23.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67652025-01-25T00:21:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67662025-01-25T00:21:23.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67672025-01-25T00:21:23.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67682025-01-25T00:21:23.984ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67692025-01-25T00:21:23.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67702025-01-25T00:21:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67712025-01-25T00:21:23.985ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = af353237-4651-4023-8604-ee309f64048e
67722025-01-25T00:21:23.985ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67732025-01-25T00:21:23.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67742025-01-25T00:21:23.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67752025-01-25T00:21:23.987ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67762025-01-25T00:21:23.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67772025-01-25T00:21:23.990ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
67782025-01-25T00:21:23.990ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("64f0f24b-50b9-47de-b30b-f05ec584db12"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c4469673-5591-441c-b548-655d11b01846")}) node_id = 7 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67792025-01-25T00:21:23.995ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = af353237-4651-4023-8604-ee309f64048e
67802025-01-25T00:21:23.995ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67812025-01-25T00:21:23.999ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
67822025-01-25T00:21:23.999ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67832025-01-25T00:21:24.004ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = af353237-4651-4023-8604-ee309f64048e
67842025-01-25T00:21:24.004ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67852025-01-25T00:21:24.008ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 propolis_id = c4469673-5591-441c-b548-655d11b01846 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
67862025-01-25T00:21:24.008ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ReleaseSledResources
67872025-01-25T00:21:24.009ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ReleaseSledResources
67882025-01-25T00:21:24.022ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67892025-01-25T00:21:24.022ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67902025-01-25T00:21:24.022ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ef104c7-f5cb-4160-b3ec-0c3993392a77", "content-length": "372", "date": "Sat, 25 Jan 2025 00:21:24 GMT"} })
67912025-01-25T00:21:24.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67922025-01-25T00:21:24.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67932025-01-25T00:21:24.028ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
67942025-01-25T00:21:24.028ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67952025-01-25T00:21:24.031ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = af353237-4651-4023-8604-ee309f64048e
67962025-01-25T00:21:24.031ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
67972025-01-25T00:21:24.035ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 propolis_id = c4469673-5591-441c-b548-655d11b01846 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
67982025-01-25T00:21:24.035ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = MarkVmmDeleted
67992025-01-25T00:21:24.035ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = MarkVmmDeleted
68002025-01-25T00:21:24.046ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
68012025-01-25T00:21:24.046ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
68022025-01-25T00:21:24.050ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = af353237-4651-4023-8604-ee309f64048e
68032025-01-25T00:21:24.050ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
68042025-01-25T00:21:24.053ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
68052025-01-25T00:21:24.053ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
68062025-01-25T00:21:24.056ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = af353237-4651-4023-8604-ee309f64048e
68072025-01-25T00:21:24.056ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
68082025-01-25T00:21:24.057ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68092025-01-25T00:21:24.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68102025-01-25T00:21:24.060ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ChainSuccessorSaga
68112025-01-25T00:21:24.060ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ChainSuccessorSaga
68122025-01-25T00:21:24.062ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ChainSuccessorSaga
68132025-01-25T00:21:24.062ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ChainSuccessorSaga
68142025-01-25T00:21:24.063ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ChainSuccessorSaga
68152025-01-25T00:21:24.064ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ChainSuccessorSaga
68162025-01-25T00:21:24.065ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ChainSuccessorSaga
68172025-01-25T00:21:24.068ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fd047cff-047f-41d5-9f37-bd6037bf08d8, lookup_type: ById(fd047cff-047f-41d5-9f37-bd6037bf08d8) }, key: 3744141e-2339-4876-b994-4d29dab4c911, lookup_type: ById(3744141e-2339-4876-b994-4d29dab4c911) }, key: 64f0f24b-50b9-47de-b30b-f05ec584db12, lookup_type: ById(64f0f24b-50b9-47de-b30b-f05ec584db12) } result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ChainSuccessorSaga
68182025-01-25T00:21:24.068ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ChainSuccessorSaga
68192025-01-25T00:21:24.068ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_node = ChainSuccessorSaga
68202025-01-25T00:21:24.070ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {137a3e71-078c-410e-aa4f-4b521683d898: {10.151.1.175: {b6b76b23-46d8-4cf4-8ef8-06ebb296975d}, 10.151.1.176: {b6b76b23-46d8-4cf4-8ef8-06ebb296975d}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
68212025-01-25T00:21:24.070ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68222025-01-25T00:21:24.070ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2b75b5c2-2084-4d15-8255-47140d68efac", "date": "Sat, 25 Jan 2025 00:21:24 GMT"} })
68232025-01-25T00:21:24.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68242025-01-25T00:21:24.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68252025-01-25T00:21:24.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68262025-01-25T00:21:24.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68272025-01-25T00:21:24.074ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 karmic_state = WillReincarnate needs_reincarnation = false saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update
68282025-01-25T00:21:24.074ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
68292025-01-25T00:21:24.074ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
68302025-01-25T00:21:24.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68312025-01-25T00:21:24.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68322025-01-25T00:21:24.077ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = af353237-4651-4023-8604-ee309f64048e
68332025-01-25T00:21:24.077ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
68342025-01-25T00:21:24.078ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68352025-01-25T00:21:24.078ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68362025-01-25T00:21:24.078ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8b72d4c0-53b3-4ffe-82ac-55360dd9ac6c", "date": "Sat, 25 Jan 2025 00:21:24 GMT"} })
68372025-01-25T00:21:24.079ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 99.204067ms iteration = 24 status = {}
68382025-01-25T00:21:24.080ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
68392025-01-25T00:21:24.080ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
68402025-01-25T00:21:24.084ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d sec_id = af353237-4651-4023-8604-ee309f64048e
68412025-01-25T00:21:24.084ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d
68422025-01-25T00:21:24.124ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update sec_id = af353237-4651-4023-8604-ee309f64048e
68432025-01-25T00:21:24.124ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d saga_name = instance-update saga_result = SagaResult { saga_id: ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d, saga_log: SagaLog { saga_id: ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("25c2e8f2-6e98-483a-adb3-d295dbfa731e")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("25c2e8f2-6e98-483a-adb3-d295dbfa731e")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("64f0f24b-50b9-47de-b30b-f05ec584db12"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c4469673-5591-441c-b548-655d11b01846")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("64f0f24b-50b9-47de-b30b-f05ec584db12"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c4469673-5591-441c-b548-655d11b01846")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("25c2e8f2-6e98-483a-adb3-d295dbfa731e"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("25c2e8f2-6e98-483a-adb3-d295dbfa731e")}} }) }
68442025-01-25T00:21:24.124ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = ff7c4dbc-83ff-4c30-81fa-0a9508fcaa1d instance_id = 64f0f24b-50b9-47de-b30b-f05ec584db12 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update
68452025-01-25T00:21:24.124ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
68462025-01-25T00:21:24.124ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff
68472025-01-25T00:21:24.130ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = af353237-4651-4023-8604-ee309f64048e
68482025-01-25T00:21:24.130ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff
68492025-01-25T00:21:24.135ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = af353237-4651-4023-8604-ee309f64048e
68502025-01-25T00:21:24.135ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff
68512025-01-25T00:21:24.139ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff sec_id = af353237-4651-4023-8604-ee309f64048e
68522025-01-25T00:21:24.139ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff
68532025-01-25T00:21:24.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68542025-01-25T00:21:24.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68552025-01-25T00:21:24.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68562025-01-25T00:21:24.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68572025-01-25T00:21:24.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68582025-01-25T00:21:24.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68592025-01-25T00:21:24.148ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68602025-01-25T00:21:24.150ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68612025-01-25T00:21:24.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68622025-01-25T00:21:24.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68632025-01-25T00:21:24.179ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update sec_id = af353237-4651-4023-8604-ee309f64048e
68642025-01-25T00:21:24.179ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = cecca89e-9b25-47d3-a98e-a380a36301ff saga_name = start-instance-update saga_result = SagaResult { saga_id: cecca89e-9b25-47d3-a98e-a380a36301ff, saga_log: SagaLog { saga_id: cecca89e-9b25-47d3-a98e-a380a36301ff, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("bd142724-00ce-46d4-8059-f12bba4dad67")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("bd142724-00ce-46d4-8059-f12bba4dad67")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("bd142724-00ce-46d4-8059-f12bba4dad67"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("bd142724-00ce-46d4-8059-f12bba4dad67")}} }) }
68652025-01-25T00:21:24.184ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68662025-01-25T00:21:24.185ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "269ce943-4b68-4bde-891c-ffb4627f1216", "content-length": "691", "date": "Sat, 25 Jan 2025 00:21:24 GMT"} })
68672025-01-25T00:21:24.185ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
68682025-01-25T00:21:24.185ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
68692025-01-25T00:21:24.185ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
68702025-01-25T00:21:24.187ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 206.800007ms iteration = 24 status = {}
68712025-01-25T00:21:24.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = fd6e4eac-b80f-4ae6-ad2c-9e480c263ca5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
68722025-01-25T00:21:24.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = fd6e4eac-b80f-4ae6-ad2c-9e480c263ca5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
68732025-01-25T00:21:24.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = fd6e4eac-b80f-4ae6-ad2c-9e480c263ca5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
68742025-01-25T00:21:24.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9d4610ae-6ea4-41e3-b753-66517bc5cb05 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68752025-01-25T00:21:24.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9d4610ae-6ea4-41e3-b753-66517bc5cb05 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68762025-01-25T00:21:24.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9d4610ae-6ea4-41e3-b753-66517bc5cb05 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68772025-01-25T00:21:25.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 69667cb5-6506-4dc1-9c87-a12170fbfe0d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
68782025-01-25T00:21:25.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 69667cb5-6506-4dc1-9c87-a12170fbfe0d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
68792025-01-25T00:21:25.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2616 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 69667cb5-6506-4dc1-9c87-a12170fbfe0d response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
68802025-01-25T00:21:25.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8b03d87-ba75-4858-9755-8fa812505bef roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68812025-01-25T00:21:25.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8b03d87-ba75-4858-9755-8fa812505bef resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68822025-01-25T00:21:25.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8b03d87-ba75-4858-9755-8fa812505bef response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68832025-01-25T00:21:26.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5a204a83-321c-406c-bbb4-33e303dc5ced roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68842025-01-25T00:21:26.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5a204a83-321c-406c-bbb4-33e303dc5ced resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68852025-01-25T00:21:26.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5a204a83-321c-406c-bbb4-33e303dc5ced response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68862025-01-25T00:21:27.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3563126d-38d9-40a8-b8d8-431dfbbf7456 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68872025-01-25T00:21:27.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3563126d-38d9-40a8-b8d8-431dfbbf7456 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68882025-01-25T00:21:27.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3563126d-38d9-40a8-b8d8-431dfbbf7456 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
68892025-01-25T00:21:28.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
68902025-01-25T00:21:28.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68912025-01-25T00:21:28.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68922025-01-25T00:21:28.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
68932025-01-25T00:21:28.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68942025-01-25T00:21:28.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68952025-01-25T00:21:28.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68962025-01-25T00:21:28.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68972025-01-25T00:21:28.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68982025-01-25T00:21:28.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68992025-01-25T00:21:28.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69002025-01-25T00:21:28.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69012025-01-25T00:21:28.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69022025-01-25T00:21:28.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69032025-01-25T00:21:28.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69042025-01-25T00:21:28.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
69052025-01-25T00:21:28.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69062025-01-25T00:21:28.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69072025-01-25T00:21:28.445ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
69082025-01-25T00:21:28.445ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.935285ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
69092025-01-25T00:21:28.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.953481ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69102025-01-25T00:21:28.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8181afe-7b81-4189-8c83-e60e6fc571d1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69112025-01-25T00:21:28.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8181afe-7b81-4189-8c83-e60e6fc571d1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69122025-01-25T00:21:28.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8181afe-7b81-4189-8c83-e60e6fc571d1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69132025-01-25T00:21:29.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b3bb27a9-8263-4ff6-af7c-2814c0fb5fff roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69142025-01-25T00:21:29.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b3bb27a9-8263-4ff6-af7c-2814c0fb5fff resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69152025-01-25T00:21:29.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b3bb27a9-8263-4ff6-af7c-2814c0fb5fff response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69162025-01-25T00:21:30.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 811734c1-bd5f-4cfe-998a-af2034803bdc roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69172025-01-25T00:21:30.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 811734c1-bd5f-4cfe-998a-af2034803bdc resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69182025-01-25T00:21:30.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 811734c1-bd5f-4cfe-998a-af2034803bdc response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69192025-01-25T00:21:30.985ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 592 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = b9bd0d55-1487-4fb1-a9e0-360342e8b3b4 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
69202025-01-25T00:21:31.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8d7f703-1f3f-4ca5-86ca-295c8d717659 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69212025-01-25T00:21:31.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8d7f703-1f3f-4ca5-86ca-295c8d717659 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69222025-01-25T00:21:31.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f8d7f703-1f3f-4ca5-86ca-295c8d717659 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69232025-01-25T00:21:33.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1dcbe9b5-5d85-4619-8dcb-c9b31fbc63b7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69242025-01-25T00:21:33.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1dcbe9b5-5d85-4619-8dcb-c9b31fbc63b7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69252025-01-25T00:21:33.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1dcbe9b5-5d85-4619-8dcb-c9b31fbc63b7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69262025-01-25T00:21:34.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 59d13bff-49fd-448f-9e8e-42b9b3904b2f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69272025-01-25T00:21:34.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 59d13bff-49fd-448f-9e8e-42b9b3904b2f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69282025-01-25T00:21:34.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 59d13bff-49fd-448f-9e8e-42b9b3904b2f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69292025-01-25T00:21:35.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2a33d4ae-de5e-4d11-a447-e07aef345c77 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69302025-01-25T00:21:35.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2a33d4ae-de5e-4d11-a447-e07aef345c77 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69312025-01-25T00:21:35.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2a33d4ae-de5e-4d11-a447-e07aef345c77 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69322025-01-25T00:21:36.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 75d475cf-d5a2-4704-8dad-048097a22a4c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69332025-01-25T00:21:36.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 75d475cf-d5a2-4704-8dad-048097a22a4c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69342025-01-25T00:21:36.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 75d475cf-d5a2-4704-8dad-048097a22a4c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69352025-01-25T00:21:37.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 487a00d4-da6f-4856-903f-4e6eea92643f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69362025-01-25T00:21:37.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 487a00d4-da6f-4856-903f-4e6eea92643f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69372025-01-25T00:21:37.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 487a00d4-da6f-4856-903f-4e6eea92643f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69382025-01-25T00:21:38.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cc9f0ced-1dc7-4569-b5e3-aa3b28a9e877 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69392025-01-25T00:21:38.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cc9f0ced-1dc7-4569-b5e3-aa3b28a9e877 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69402025-01-25T00:21:38.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cc9f0ced-1dc7-4569-b5e3-aa3b28a9e877 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69412025-01-25T00:21:38.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
69422025-01-25T00:21:38.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69432025-01-25T00:21:38.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69442025-01-25T00:21:38.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
69452025-01-25T00:21:38.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69462025-01-25T00:21:38.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69472025-01-25T00:21:38.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69482025-01-25T00:21:38.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69492025-01-25T00:21:38.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69502025-01-25T00:21:38.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69512025-01-25T00:21:38.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69522025-01-25T00:21:38.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69532025-01-25T00:21:38.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69542025-01-25T00:21:38.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69552025-01-25T00:21:38.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69562025-01-25T00:21:38.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
69572025-01-25T00:21:38.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69582025-01-25T00:21:38.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69592025-01-25T00:21:38.441ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
69602025-01-25T00:21:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.930393ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
69612025-01-25T00:21:38.453ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.634815ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69622025-01-25T00:21:39.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e232c312-61d5-4a95-ba0d-619fd84cff0a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69632025-01-25T00:21:39.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e232c312-61d5-4a95-ba0d-619fd84cff0a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69642025-01-25T00:21:39.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e232c312-61d5-4a95-ba0d-619fd84cff0a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69652025-01-25T00:21:40.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5148655a-adae-4652-8267-19ca85b65ae2 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69662025-01-25T00:21:40.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5148655a-adae-4652-8267-19ca85b65ae2 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69672025-01-25T00:21:40.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5148655a-adae-4652-8267-19ca85b65ae2 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69682025-01-25T00:21:40.985ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 579 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 41e2e3bd-0fea-41a8-b4fa-3fdafdc3c4b7 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
69692025-01-25T00:21:41.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 081dc2ae-adc0-4645-8942-884da09b3fbd roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69702025-01-25T00:21:41.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 081dc2ae-adc0-4645-8942-884da09b3fbd resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69712025-01-25T00:21:41.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 081dc2ae-adc0-4645-8942-884da09b3fbd response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69722025-01-25T00:21:42.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6801179c-38fe-4177-bf80-af4c55c6ec4f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69732025-01-25T00:21:42.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6801179c-38fe-4177-bf80-af4c55c6ec4f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69742025-01-25T00:21:42.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6801179c-38fe-4177-bf80-af4c55c6ec4f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69752025-01-25T00:21:43.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6909ecf3-e93a-4e67-b46f-ac378dcc7c80 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69762025-01-25T00:21:43.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6909ecf3-e93a-4e67-b46f-ac378dcc7c80 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69772025-01-25T00:21:43.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 6909ecf3-e93a-4e67-b46f-ac378dcc7c80 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69782025-01-25T00:21:44.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c8aed525-c24f-4917-814f-cc8ca42799f9 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69792025-01-25T00:21:44.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c8aed525-c24f-4917-814f-cc8ca42799f9 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69802025-01-25T00:21:44.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c8aed525-c24f-4917-814f-cc8ca42799f9 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69812025-01-25T00:21:45.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d358f171-f4af-4bd7-8e58-2233e44d34a6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69822025-01-25T00:21:45.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d358f171-f4af-4bd7-8e58-2233e44d34a6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69832025-01-25T00:21:45.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d358f171-f4af-4bd7-8e58-2233e44d34a6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69842025-01-25T00:21:46.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e4206f7c-85f4-4157-8e3f-0bed9ae95c9f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69852025-01-25T00:21:46.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e4206f7c-85f4-4157-8e3f-0bed9ae95c9f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69862025-01-25T00:21:46.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e4206f7c-85f4-4157-8e3f-0bed9ae95c9f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69872025-01-25T00:21:47.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 83234202-5b94-4fb6-84e1-bb0708206704 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69882025-01-25T00:21:47.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 83234202-5b94-4fb6-84e1-bb0708206704 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69892025-01-25T00:21:47.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 83234202-5b94-4fb6-84e1-bb0708206704 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69902025-01-25T00:21:48.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99a3f70d-b330-4c16-a5ee-421c6b28f94c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69912025-01-25T00:21:48.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99a3f70d-b330-4c16-a5ee-421c6b28f94c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69922025-01-25T00:21:48.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 99a3f70d-b330-4c16-a5ee-421c6b28f94c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
69932025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
69942025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
69952025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69962025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
69972025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69982025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69992025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
70002025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
70012025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70022025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70032025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
70042025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
70052025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70062025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70072025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
70082025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
70092025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
70102025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70112025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70122025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
70132025-01-25T00:21:48.422ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70142025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
70152025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70162025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70172025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
70182025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70192025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
70202025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70212025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
70222025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70232025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70242025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
70252025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
70262025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70272025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70282025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
70292025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70302025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70312025-01-25T00:21:48.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70322025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70332025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70342025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70352025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70362025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70372025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70382025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70392025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70402025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70412025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70422025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70432025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70442025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70452025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70462025-01-25T00:21:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70472025-01-25T00:21:48.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70482025-01-25T00:21:48.425ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1631, tv_nsec: 143788054 } })
70492025-01-25T00:21:48.426ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70502025-01-25T00:21:48.426ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
70512025-01-25T00:21:48.426ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.95047ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70522025-01-25T00:21:48.427ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1631, tv_nsec: 145009720 } })
70532025-01-25T00:21:48.427ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70542025-01-25T00:21:48.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.494203ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
70552025-01-25T00:21:48.427ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
70562025-01-25T00:21:48.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70572025-01-25T00:21:48.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70582025-01-25T00:21:48.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70592025-01-25T00:21:48.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70602025-01-25T00:21:48.429ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70612025-01-25T00:21:48.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70622025-01-25T00:21:48.429ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70632025-01-25T00:21:48.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70642025-01-25T00:21:48.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70652025-01-25T00:21:48.431ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70662025-01-25T00:21:48.431ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70672025-01-25T00:21:48.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70682025-01-25T00:21:48.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70692025-01-25T00:21:48.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70702025-01-25T00:21:48.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70712025-01-25T00:21:48.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70722025-01-25T00:21:48.435ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70732025-01-25T00:21:48.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70742025-01-25T00:21:48.435ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70752025-01-25T00:21:48.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70762025-01-25T00:21:48.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70772025-01-25T00:21:48.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.970628ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
70782025-01-25T00:21:48.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70792025-01-25T00:21:48.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70802025-01-25T00:21:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70812025-01-25T00:21:48.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70822025-01-25T00:21:48.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70832025-01-25T00:21:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70842025-01-25T00:21:48.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70852025-01-25T00:21:48.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70862025-01-25T00:21:48.448ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1631, tv_nsec: 166273461 } })
70872025-01-25T00:21:48.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
70882025-01-25T00:21:48.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70892025-01-25T00:21:48.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70902025-01-25T00:21:48.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70912025-01-25T00:21:48.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70922025-01-25T00:21:48.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70932025-01-25T00:21:48.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70942025-01-25T00:21:48.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70952025-01-25T00:21:48.458ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70962025-01-25T00:21:48.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70972025-01-25T00:21:48.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70982025-01-25T00:21:48.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70992025-01-25T00:21:48.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
71002025-01-25T00:21:48.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71012025-01-25T00:21:48.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71022025-01-25T00:21:48.486ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71032025-01-25T00:21:48.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71042025-01-25T00:21:48.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71052025-01-25T00:21:48.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71062025-01-25T00:21:48.493ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71072025-01-25T00:21:48.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71082025-01-25T00:21:48.500ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71092025-01-25T00:21:48.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71102025-01-25T00:21:48.511ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71112025-01-25T00:21:48.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71122025-01-25T00:21:48.512ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71132025-01-25T00:21:48.512ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.715227ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
71142025-01-25T00:21:48.512ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71152025-01-25T00:21:48.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71162025-01-25T00:21:48.515ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71172025-01-25T00:21:48.515ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71182025-01-25T00:21:48.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71192025-01-25T00:21:48.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71202025-01-25T00:21:48.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71212025-01-25T00:21:48.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71222025-01-25T00:21:48.560ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
71232025-01-25T00:21:48.560ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71242025-01-25T00:21:48.560ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5ff48ec-8d91-41f7-bd13-9569f42d38cf", "content-length": "26", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
71252025-01-25T00:21:48.560ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71262025-01-25T00:21:48.561ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71272025-01-25T00:21:48.571ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
71282025-01-25T00:21:48.571ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71292025-01-25T00:21:48.572ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ddb1451-2e4c-4202-b407-a994ef339d33", "content-length": "26", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
71302025-01-25T00:21:48.572ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71312025-01-25T00:21:48.573ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
71322025-01-25T00:21:48.584ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.953543ms iteration = 27 status = {"physical_disks_added":0}
71332025-01-25T00:21:48.605ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
71342025-01-25T00:21:48.605ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71352025-01-25T00:21:48.605ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e51fb9d-180f-45c3-a6cc-b4b9c572495f", "content-length": "26", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
71362025-01-25T00:21:48.605ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71372025-01-25T00:21:48.607ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71382025-01-25T00:21:48.646ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71392025-01-25T00:21:48.646ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71402025-01-25T00:21:48.646ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "947b3b4b-4cf3-4de9-a0db-d8759c0cd49f", "content-length": "372", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
71412025-01-25T00:21:48.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71422025-01-25T00:21:48.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71432025-01-25T00:21:48.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71442025-01-25T00:21:48.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71452025-01-25T00:21:48.653ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71462025-01-25T00:21:48.654ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c71587dd-572d-4743-9956-1816488a7419", "content-length": "2", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
71472025-01-25T00:21:48.655ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71482025-01-25T00:21:48.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71492025-01-25T00:21:48.658ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 235.860498ms iteration = 24 status = null
71502025-01-25T00:21:48.668ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
71512025-01-25T00:21:48.668ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 245.658539ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
71522025-01-25T00:21:48.678ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 255.887802ms iteration = 24 status = {}
71532025-01-25T00:21:48.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 263.148681ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71542025-01-25T00:21:48.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 264.051195ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71552025-01-25T00:21:48.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 271.769376ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71562025-01-25T00:21:48.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71572025-01-25T00:21:48.694ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71582025-01-25T00:21:48.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71592025-01-25T00:21:48.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
71602025-01-25T00:21:48.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71612025-01-25T00:21:48.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71622025-01-25T00:21:48.698ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 276.484079ms iteration = 24 status = 0
71632025-01-25T00:21:48.698ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71642025-01-25T00:21:48.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
71652025-01-25T00:21:48.700ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71662025-01-25T00:21:48.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71672025-01-25T00:21:48.702ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71682025-01-25T00:21:48.702ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71692025-01-25T00:21:48.702ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71702025-01-25T00:21:48.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71712025-01-25T00:21:48.718ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
71722025-01-25T00:21:48.718ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71732025-01-25T00:21:48.718ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c2506301-1a30-40e9-8b58-dd665cb374c7", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
71742025-01-25T00:21:48.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71752025-01-25T00:21:48.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71762025-01-25T00:21:48.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71772025-01-25T00:21:48.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71782025-01-25T00:21:48.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71792025-01-25T00:21:48.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71802025-01-25T00:21:48.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 304.048284ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71812025-01-25T00:21:48.727ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
71822025-01-25T00:21:48.727ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71832025-01-25T00:21:48.727ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c82b8c5f-140b-4336-a6d6-734c38ba16e3", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
71842025-01-25T00:21:48.729ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
71852025-01-25T00:21:48.729ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 306.570167ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
71862025-01-25T00:21:48.729ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 306.610067ms iteration = 25 status = {}
71872025-01-25T00:21:48.734ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71882025-01-25T00:21:48.734ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71892025-01-25T00:21:48.734ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 311.367692ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71902025-01-25T00:21:48.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71912025-01-25T00:21:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71922025-01-25T00:21:48.737ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
71932025-01-25T00:21:48.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71942025-01-25T00:21:48.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71952025-01-25T00:21:48.746ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71962025-01-25T00:21:48.746ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "de8ca15c-3e22-4603-8c1b-939700ed2dc9", "content-length": "134", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
71972025-01-25T00:21:48.746ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
71982025-01-25T00:21:48.746ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
71992025-01-25T00:21:48.746ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72002025-01-25T00:21:48.746ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72012025-01-25T00:21:48.746ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72022025-01-25T00:21:48.746ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72032025-01-25T00:21:48.746ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72042025-01-25T00:21:48.746ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72052025-01-25T00:21:48.747ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72062025-01-25T00:21:48.747ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72072025-01-25T00:21:48.747ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
72082025-01-25T00:21:48.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72092025-01-25T00:21:48.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72102025-01-25T00:21:48.749ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72112025-01-25T00:21:48.749ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4af6a146-bf56-4378-bba8-e70aa955a025", "content-length": "2", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
72122025-01-25T00:21:48.749ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72132025-01-25T00:21:48.749ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e2e084e-cd33-4df6-857e-25fefa08a97a", "content-length": "52", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
72142025-01-25T00:21:48.749ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
72152025-01-25T00:21:48.749ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72162025-01-25T00:21:48.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72172025-01-25T00:21:48.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72182025-01-25T00:21:48.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72192025-01-25T00:21:48.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72202025-01-25T00:21:48.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72212025-01-25T00:21:48.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72222025-01-25T00:21:48.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72232025-01-25T00:21:48.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72242025-01-25T00:21:48.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72252025-01-25T00:21:48.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72262025-01-25T00:21:48.874ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "32657af4-258a-44af-87f5-a9f3e6ccd32b", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
72272025-01-25T00:21:48.874ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
72282025-01-25T00:21:48.874ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72292025-01-25T00:21:48.874ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "86f97080-e104-4b39-b348-54dcac76146e", "content-length": "682", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
72302025-01-25T00:21:48.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72312025-01-25T00:21:48.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72322025-01-25T00:21:48.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72332025-01-25T00:21:48.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72342025-01-25T00:21:48.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72352025-01-25T00:21:48.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72362025-01-25T00:21:48.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72372025-01-25T00:21:48.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72382025-01-25T00:21:48.892ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 470.445279ms iteration = 24 status = {}
72392025-01-25T00:21:48.912ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72402025-01-25T00:21:48.915ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1829c11f-64ab-4236-bff5-94f49a3592be", "content-length": "691", "date": "Sat, 25 Jan 2025 00:21:48 GMT"} })
72412025-01-25T00:21:48.915ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72422025-01-25T00:21:48.915ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72432025-01-25T00:21:48.915ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72442025-01-25T00:21:48.917ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 495.073438ms iteration = 25 status = {}
72452025-01-25T00:21:49.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 532b0f20-c98c-4e8e-8609-9036c74585e5 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72462025-01-25T00:21:49.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 532b0f20-c98c-4e8e-8609-9036c74585e5 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72472025-01-25T00:21:49.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 532b0f20-c98c-4e8e-8609-9036c74585e5 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72482025-01-25T00:21:50.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 999d0681-10de-443e-93df-561a5ff94c18 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72492025-01-25T00:21:50.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 999d0681-10de-443e-93df-561a5ff94c18 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72502025-01-25T00:21:50.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 999d0681-10de-443e-93df-561a5ff94c18 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72512025-01-25T00:21:50.986ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 513 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 8523d2dc-be3b-4ef8-8501-2038923ef1a6 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
72522025-01-25T00:21:51.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0209842f-847e-48f4-8588-f93657bae5df roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72532025-01-25T00:21:51.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0209842f-847e-48f4-8588-f93657bae5df resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72542025-01-25T00:21:51.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2581 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0209842f-847e-48f4-8588-f93657bae5df response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72552025-01-25T00:21:52.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2d1dc63c-287f-41d4-9b0a-0952d4a9604c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72562025-01-25T00:21:52.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2d1dc63c-287f-41d4-9b0a-0952d4a9604c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72572025-01-25T00:21:52.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2d1dc63c-287f-41d4-9b0a-0952d4a9604c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72582025-01-25T00:21:53.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 734236cf-03ce-4131-b430-c278e8b886e6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72592025-01-25T00:21:53.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 734236cf-03ce-4131-b430-c278e8b886e6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72602025-01-25T00:21:53.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 734236cf-03ce-4131-b430-c278e8b886e6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72612025-01-25T00:21:54.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0b826058-e66a-43c4-a7cf-abf965019b2f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72622025-01-25T00:21:54.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0b826058-e66a-43c4-a7cf-abf965019b2f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72632025-01-25T00:21:54.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0b826058-e66a-43c4-a7cf-abf965019b2f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72642025-01-25T00:21:55.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 74c9142a-893f-4d43-903a-eb6ce93c95ef roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72652025-01-25T00:21:55.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 74c9142a-893f-4d43-903a-eb6ce93c95ef resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72662025-01-25T00:21:55.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 74c9142a-893f-4d43-903a-eb6ce93c95ef response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72672025-01-25T00:21:55.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 0c36cd78-2159-4796-b016-3adc3cc773ac roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
72682025-01-25T00:21:55.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 0c36cd78-2159-4796-b016-3adc3cc773ac resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
72692025-01-25T00:21:55.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 0c36cd78-2159-4796-b016-3adc3cc773ac response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
72702025-01-25T00:21:56.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 55e1f254-07e2-4aea-a9ba-56450280b32a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72712025-01-25T00:21:56.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 55e1f254-07e2-4aea-a9ba-56450280b32a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72722025-01-25T00:21:56.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 55e1f254-07e2-4aea-a9ba-56450280b32a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72732025-01-25T00:21:57.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9525e2f8-497e-4413-8fc1-a774d58a323e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72742025-01-25T00:21:57.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9525e2f8-497e-4413-8fc1-a774d58a323e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72752025-01-25T00:21:57.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9525e2f8-497e-4413-8fc1-a774d58a323e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72762025-01-25T00:21:58.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
72772025-01-25T00:21:58.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72782025-01-25T00:21:58.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72792025-01-25T00:21:58.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
72802025-01-25T00:21:58.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72812025-01-25T00:21:58.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72822025-01-25T00:21:58.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72832025-01-25T00:21:58.452ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72842025-01-25T00:21:58.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72852025-01-25T00:21:58.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72862025-01-25T00:21:58.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72872025-01-25T00:21:58.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72882025-01-25T00:21:58.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.232208ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72892025-01-25T00:21:58.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72902025-01-25T00:21:58.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72912025-01-25T00:21:58.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72922025-01-25T00:21:58.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
72932025-01-25T00:21:58.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72942025-01-25T00:21:58.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72952025-01-25T00:21:58.470ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
72962025-01-25T00:21:58.470ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.805084ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
72972025-01-25T00:21:58.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d14b657f-c608-4f9b-9ac2-24eec37aed47 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72982025-01-25T00:21:58.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d14b657f-c608-4f9b-9ac2-24eec37aed47 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
72992025-01-25T00:21:58.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d14b657f-c608-4f9b-9ac2-24eec37aed47 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73002025-01-25T00:21:59.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 41988961-d263-49b4-9eb1-8fb388027458 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73012025-01-25T00:21:59.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 41988961-d263-49b4-9eb1-8fb388027458 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73022025-01-25T00:21:59.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 41988961-d263-49b4-9eb1-8fb388027458 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73032025-01-25T00:22:00.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 307edac9-c280-46b6-9a0b-c8849a21a4c3 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73042025-01-25T00:22:00.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 307edac9-c280-46b6-9a0b-c8849a21a4c3 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73052025-01-25T00:22:00.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 307edac9-c280-46b6-9a0b-c8849a21a4c3 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73062025-01-25T00:22:00.986ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 5313ba8d-21e7-41e6-9ae7-bb2939d3fb5d response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
73072025-01-25T00:22:01.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a1848d48-b4c1-42bf-bc41-e05c213b637f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73082025-01-25T00:22:01.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a1848d48-b4c1-42bf-bc41-e05c213b637f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73092025-01-25T00:22:01.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a1848d48-b4c1-42bf-bc41-e05c213b637f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73102025-01-25T00:22:02.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c09ca30e-c1f3-4695-8c74-4848a1ecf737 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73112025-01-25T00:22:02.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c09ca30e-c1f3-4695-8c74-4848a1ecf737 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73122025-01-25T00:22:02.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c09ca30e-c1f3-4695-8c74-4848a1ecf737 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73132025-01-25T00:22:03.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8feaec08-a550-4142-8f4b-535802dabfb5 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73142025-01-25T00:22:03.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8feaec08-a550-4142-8f4b-535802dabfb5 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73152025-01-25T00:22:03.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8feaec08-a550-4142-8f4b-535802dabfb5 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73162025-01-25T00:22:04.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 26498111-9340-4ccf-84d1-366e25ceed70 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73172025-01-25T00:22:04.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 26498111-9340-4ccf-84d1-366e25ceed70 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73182025-01-25T00:22:04.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 26498111-9340-4ccf-84d1-366e25ceed70 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73192025-01-25T00:22:05.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dc52b826-333f-4633-9f45-46ca0bc165b5 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73202025-01-25T00:22:05.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dc52b826-333f-4633-9f45-46ca0bc165b5 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73212025-01-25T00:22:05.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dc52b826-333f-4633-9f45-46ca0bc165b5 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73222025-01-25T00:22:06.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3aa1b50c-1351-4cd6-a5d1-c6396b3d758b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73232025-01-25T00:22:06.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3aa1b50c-1351-4cd6-a5d1-c6396b3d758b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73242025-01-25T00:22:06.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3aa1b50c-1351-4cd6-a5d1-c6396b3d758b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73252025-01-25T00:22:07.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3e63ad64-f462-4e48-a38c-7778b12fe35c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73262025-01-25T00:22:07.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3e63ad64-f462-4e48-a38c-7778b12fe35c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73272025-01-25T00:22:07.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3e63ad64-f462-4e48-a38c-7778b12fe35c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73282025-01-25T00:22:08.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
73292025-01-25T00:22:08.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73302025-01-25T00:22:08.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73312025-01-25T00:22:08.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
73322025-01-25T00:22:08.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73332025-01-25T00:22:08.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73342025-01-25T00:22:08.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73352025-01-25T00:22:08.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73362025-01-25T00:22:08.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73372025-01-25T00:22:08.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73382025-01-25T00:22:08.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73392025-01-25T00:22:08.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73402025-01-25T00:22:08.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73412025-01-25T00:22:08.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73422025-01-25T00:22:08.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73432025-01-25T00:22:08.461ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.817997ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73442025-01-25T00:22:08.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
73452025-01-25T00:22:08.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73462025-01-25T00:22:08.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73472025-01-25T00:22:08.474ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
73482025-01-25T00:22:08.474ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.788699ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
73492025-01-25T00:22:08.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5221e89a-daeb-4dd5-aeba-52f658d2baad roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73502025-01-25T00:22:08.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5221e89a-daeb-4dd5-aeba-52f658d2baad resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73512025-01-25T00:22:08.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5221e89a-daeb-4dd5-aeba-52f658d2baad response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73522025-01-25T00:22:09.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f4bdf58c-7749-452e-973f-94962b51f7d7 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73532025-01-25T00:22:09.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f4bdf58c-7749-452e-973f-94962b51f7d7 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73542025-01-25T00:22:09.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f4bdf58c-7749-452e-973f-94962b51f7d7 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73552025-01-25T00:22:10.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a631f65f-849a-49be-b0d9-b5d762485c8a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73562025-01-25T00:22:10.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a631f65f-849a-49be-b0d9-b5d762485c8a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73572025-01-25T00:22:10.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a631f65f-849a-49be-b0d9-b5d762485c8a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73582025-01-25T00:22:10.986ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 945 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = f663b67a-a6c8-40c7-88fa-fac8263e3a2a response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
73592025-01-25T00:22:11.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9a84cb5e-1bd0-4b8d-a398-53a4df98662a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73602025-01-25T00:22:11.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9a84cb5e-1bd0-4b8d-a398-53a4df98662a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73612025-01-25T00:22:11.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9a84cb5e-1bd0-4b8d-a398-53a4df98662a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73622025-01-25T00:22:12.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4fe14e69-7472-4063-9efd-1c2edac77c2c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73632025-01-25T00:22:12.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4fe14e69-7472-4063-9efd-1c2edac77c2c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73642025-01-25T00:22:12.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4fe14e69-7472-4063-9efd-1c2edac77c2c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73652025-01-25T00:22:13.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = aafad990-b4b3-451c-9eed-753e288c3ec6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73662025-01-25T00:22:13.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = aafad990-b4b3-451c-9eed-753e288c3ec6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73672025-01-25T00:22:13.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = aafad990-b4b3-451c-9eed-753e288c3ec6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73682025-01-25T00:22:14.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e83f37d0-a94f-4d39-866d-86a1e066bdc6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73692025-01-25T00:22:14.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e83f37d0-a94f-4d39-866d-86a1e066bdc6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73702025-01-25T00:22:14.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e83f37d0-a94f-4d39-866d-86a1e066bdc6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73712025-01-25T00:22:15.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 84555d4d-7dcd-44f4-af43-25cbfde23ce5 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73722025-01-25T00:22:15.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 84555d4d-7dcd-44f4-af43-25cbfde23ce5 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73732025-01-25T00:22:15.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 84555d4d-7dcd-44f4-af43-25cbfde23ce5 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73742025-01-25T00:22:16.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5087ad6b-fbb0-465a-8e8b-036012eeb117 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73752025-01-25T00:22:16.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5087ad6b-fbb0-465a-8e8b-036012eeb117 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73762025-01-25T00:22:16.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5087ad6b-fbb0-465a-8e8b-036012eeb117 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73772025-01-25T00:22:17.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bdebaa05-8567-46d0-b709-1acdd0da6468 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73782025-01-25T00:22:17.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bdebaa05-8567-46d0-b709-1acdd0da6468 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73792025-01-25T00:22:17.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bdebaa05-8567-46d0-b709-1acdd0da6468 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
73802025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
73812025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
73822025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
73832025-01-25T00:22:18.422ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2
73842025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.4\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2"}
73852025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
73862025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
73872025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
73882025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73892025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73902025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73912025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
73922025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
73932025-01-25T00:22:18.422ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
73942025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
73952025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
73962025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
73972025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
73982025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73992025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
74002025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
74012025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74022025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
74032025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74042025-01-25T00:22:18.422ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
74052025-01-25T00:22:18.423ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-25 00:12:18.422765678 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
74062025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
74072025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
74082025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
74092025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
74102025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74112025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
74122025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74132025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74142025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
74152025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74162025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
74172025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74182025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
74192025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
74202025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74212025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
74222025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74232025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74242025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74252025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74262025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
74272025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74282025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
74292025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74302025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74312025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
74322025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74332025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
74342025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74352025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74362025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74372025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74382025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
74392025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
74402025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74412025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
74422025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74432025-01-25T00:22:18.423ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74442025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74452025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74462025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74472025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
74482025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
74492025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
74502025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
74512025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
74522025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74532025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74542025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74552025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
74562025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
74572025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74582025-01-25T00:22:18.423ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("167a4f68-f407-48e5-a9a6-22f96a22bf2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3a6aa3c-ea79-4881-9aa5-b12ba496f837.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1661, tv_nsec: 140851559 } })
74592025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74602025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74612025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74622025-01-25T00:22:18.423ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22685765-7656-499f-8835-1c19f38e16e6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1661, tv_nsec: 140947099 } })
74632025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74642025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74652025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74662025-01-25T00:22:18.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74672025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74682025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
74692025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74702025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74712025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74722025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74732025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74742025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74752025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74762025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
74772025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
74782025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.584318ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
74792025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74802025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74812025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
74822025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.532048ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
74832025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74842025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74852025-01-25T00:22:18.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74862025-01-25T00:22:18.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74872025-01-25T00:22:18.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74882025-01-25T00:22:18.426ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74892025-01-25T00:22:18.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74902025-01-25T00:22:18.427ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.492703ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
74912025-01-25T00:22:18.428ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1661, tv_nsec: 145428463 } })
74922025-01-25T00:22:18.428ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
74932025-01-25T00:22:18.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74942025-01-25T00:22:18.429ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74952025-01-25T00:22:18.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74962025-01-25T00:22:18.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
74972025-01-25T00:22:18.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74982025-01-25T00:22:18.429ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74992025-01-25T00:22:18.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75002025-01-25T00:22:18.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75012025-01-25T00:22:18.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75022025-01-25T00:22:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75032025-01-25T00:22:18.431ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75042025-01-25T00:22:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75052025-01-25T00:22:18.431ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75062025-01-25T00:22:18.431ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75072025-01-25T00:22:18.433ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75082025-01-25T00:22:18.433ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1661, tv_nsec: 150954021 } })
75092025-01-25T00:22:18.433ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-25 00:12:18.422765678 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
75102025-01-25T00:22:18.433ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.214838ms iteration = 13 status = {"expiration":"2025-01-25T00:12:18.422765678Z","pruned":[]}
75112025-01-25T00:22:18.434ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
75122025-01-25T00:22:18.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75132025-01-25T00:22:18.434ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75142025-01-25T00:22:18.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
75152025-01-25T00:22:18.434ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75162025-01-25T00:22:18.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75172025-01-25T00:22:18.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75182025-01-25T00:22:18.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75192025-01-25T00:22:18.435ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75202025-01-25T00:22:18.435ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75212025-01-25T00:22:18.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75222025-01-25T00:22:18.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75232025-01-25T00:22:18.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75242025-01-25T00:22:18.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75252025-01-25T00:22:18.439ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.289485ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
75262025-01-25T00:22:18.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75272025-01-25T00:22:18.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75282025-01-25T00:22:18.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75292025-01-25T00:22:18.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75302025-01-25T00:22:18.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.665602ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
75312025-01-25T00:22:18.496ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75322025-01-25T00:22:18.496ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75332025-01-25T00:22:18.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75342025-01-25T00:22:18.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75352025-01-25T00:22:18.496ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75362025-01-25T00:22:18.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75372025-01-25T00:22:18.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.096811ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
75382025-01-25T00:22:18.498ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75392025-01-25T00:22:18.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75402025-01-25T00:22:18.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75412025-01-25T00:22:18.500ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75422025-01-25T00:22:18.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75432025-01-25T00:22:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75442025-01-25T00:22:18.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75452025-01-25T00:22:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75462025-01-25T00:22:18.501ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75472025-01-25T00:22:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75482025-01-25T00:22:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75492025-01-25T00:22:18.502ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75502025-01-25T00:22:18.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75512025-01-25T00:22:18.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75522025-01-25T00:22:18.503ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75532025-01-25T00:22:18.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75542025-01-25T00:22:18.504ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75552025-01-25T00:22:18.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75562025-01-25T00:22:18.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75572025-01-25T00:22:18.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75582025-01-25T00:22:18.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75592025-01-25T00:22:18.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75602025-01-25T00:22:18.507ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75612025-01-25T00:22:18.510ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75622025-01-25T00:22:18.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75632025-01-25T00:22:18.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75642025-01-25T00:22:18.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
75652025-01-25T00:22:18.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75662025-01-25T00:22:18.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75672025-01-25T00:22:18.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75682025-01-25T00:22:18.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75692025-01-25T00:22:18.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75702025-01-25T00:22:18.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75712025-01-25T00:22:18.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75722025-01-25T00:22:18.514ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75732025-01-25T00:22:18.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75742025-01-25T00:22:18.514ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75752025-01-25T00:22:18.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75762025-01-25T00:22:18.516ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75772025-01-25T00:22:18.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75782025-01-25T00:22:18.517ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75792025-01-25T00:22:18.517ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75802025-01-25T00:22:18.517ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75812025-01-25T00:22:18.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75822025-01-25T00:22:18.518ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
75832025-01-25T00:22:18.518ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
75842025-01-25T00:22:18.518ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 94.468932ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
75852025-01-25T00:22:18.519ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75862025-01-25T00:22:18.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75872025-01-25T00:22:18.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75882025-01-25T00:22:18.520ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1661, tv_nsec: 237998354 } })
75892025-01-25T00:22:18.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75902025-01-25T00:22:18.521ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
75912025-01-25T00:22:18.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75922025-01-25T00:22:18.522ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75932025-01-25T00:22:18.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75942025-01-25T00:22:18.523ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75952025-01-25T00:22:18.523ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75962025-01-25T00:22:18.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75972025-01-25T00:22:18.527ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75982025-01-25T00:22:18.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
75992025-01-25T00:22:18.532ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76002025-01-25T00:22:18.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76012025-01-25T00:22:18.541ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 119.095ms iteration = 6 status = {"nsuccess":5}
76022025-01-25T00:22:18.548ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
76032025-01-25T00:22:18.548ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
76042025-01-25T00:22:18.548ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 125.603314ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
76052025-01-25T00:22:18.553ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76062025-01-25T00:22:18.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76072025-01-25T00:22:18.556ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
76082025-01-25T00:22:18.556ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.089198ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
76092025-01-25T00:22:18.558ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76102025-01-25T00:22:18.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 134.700951ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76112025-01-25T00:22:18.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76122025-01-25T00:22:18.560ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76132025-01-25T00:22:18.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
76142025-01-25T00:22:18.564ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76152025-01-25T00:22:18.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76162025-01-25T00:22:18.564ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
76172025-01-25T00:22:18.564ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
76182025-01-25T00:22:18.564ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
76192025-01-25T00:22:18.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76202025-01-25T00:22:18.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76212025-01-25T00:22:18.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76222025-01-25T00:22:18.567ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76232025-01-25T00:22:18.567ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76242025-01-25T00:22:18.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76252025-01-25T00:22:18.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76262025-01-25T00:22:18.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76272025-01-25T00:22:18.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76282025-01-25T00:22:18.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76292025-01-25T00:22:18.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 156.918307ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76302025-01-25T00:22:18.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76312025-01-25T00:22:18.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76322025-01-25T00:22:18.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76332025-01-25T00:22:18.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76342025-01-25T00:22:18.589ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76352025-01-25T00:22:18.589ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 165.460341ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76362025-01-25T00:22:18.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76372025-01-25T00:22:18.593ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76382025-01-25T00:22:18.593ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76392025-01-25T00:22:18.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76402025-01-25T00:22:18.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76412025-01-25T00:22:18.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 173.817136ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76422025-01-25T00:22:18.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
76432025-01-25T00:22:18.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76442025-01-25T00:22:18.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76452025-01-25T00:22:18.602ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
76462025-01-25T00:22:18.602ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76472025-01-25T00:22:18.602ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
76482025-01-25T00:22:18.603ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d226e2f-900a-439d-9f22-e079a26bebc8", "content-length": "26", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} })
76492025-01-25T00:22:18.603ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76502025-01-25T00:22:18.605ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76512025-01-25T00:22:18.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76522025-01-25T00:22:18.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76532025-01-25T00:22:18.610ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 187.568216ms iteration = 25 status = 0
76542025-01-25T00:22:18.615ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
76552025-01-25T00:22:18.615ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
76562025-01-25T00:22:18.615ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
76572025-01-25T00:22:18.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76582025-01-25T00:22:18.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76592025-01-25T00:22:18.617ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
76602025-01-25T00:22:18.617ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 195.244827ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
76612025-01-25T00:22:18.617ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76622025-01-25T00:22:18.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76632025-01-25T00:22:18.620ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76642025-01-25T00:22:18.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76652025-01-25T00:22:18.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 200.386303ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
76662025-01-25T00:22:18.631ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
76672025-01-25T00:22:18.632ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
76682025-01-25T00:22:18.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76692025-01-25T00:22:18.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76702025-01-25T00:22:18.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76712025-01-25T00:22:18.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76722025-01-25T00:22:18.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76732025-01-25T00:22:18.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76742025-01-25T00:22:18.640ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
76752025-01-25T00:22:18.640ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
76762025-01-25T00:22:18.640ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-25 00:10:46.879674 UTC dns_group = internal generation = 1
76772025-01-25T00:22:18.640ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 217.590453ms iteration = 13 status = {"generation":1}
76782025-01-25T00:22:18.644ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76792025-01-25T00:22:18.644ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76802025-01-25T00:22:18.644ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 220.559918ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76812025-01-25T00:22:18.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76822025-01-25T00:22:18.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76832025-01-25T00:22:18.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76842025-01-25T00:22:18.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76852025-01-25T00:22:18.656ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
76862025-01-25T00:22:18.656ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 0 version = 2
76872025-01-25T00:22:18.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76882025-01-25T00:22:18.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76892025-01-25T00:22:18.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76902025-01-25T00:22:18.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76912025-01-25T00:22:18.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76922025-01-25T00:22:18.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76932025-01-25T00:22:18.670ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
76942025-01-25T00:22:18.670ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 246.613494ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
76952025-01-25T00:22:18.671ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
76962025-01-25T00:22:18.678ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-25T00:10:16.530962Z, time_modified: 2025-01-25T00:10:16.530962Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }) }
76972025-01-25T00:22:18.678ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 255.785952ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]}},"default_endpoint":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
76982025-01-25T00:22:18.694ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 271.814445ms iteration = 28 status = {"physical_disks_added":0}
76992025-01-25T00:22:18.702ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77002025-01-25T00:22:18.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77012025-01-25T00:22:18.787ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
77022025-01-25T00:22:18.787ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77032025-01-25T00:22:18.787ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1fd1e19-a905-49be-b4cc-e85b5bca5abd", "content-length": "26", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} })
77042025-01-25T00:22:18.787ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77052025-01-25T00:22:18.788ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77062025-01-25T00:22:18.788ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77072025-01-25T00:22:18.788ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "333ac997-3a13-4345-bbda-061cd0e2983d", "content-length": "372", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} })
77082025-01-25T00:22:18.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77092025-01-25T00:22:18.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77102025-01-25T00:22:18.789ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
77112025-01-25T00:22:18.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77122025-01-25T00:22:18.789ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 1 version = 2
77132025-01-25T00:22:18.789ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
77142025-01-25T00:22:18.789ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-25 00:10:47.835608 UTC dns_group = external generation = 2
77152025-01-25T00:22:18.789ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 367.177221ms iteration = 13 status = {"generation":2}
77162025-01-25T00:22:18.790ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
77172025-01-25T00:22:18.790ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77182025-01-25T00:22:18.791ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4d07f05-01bd-450d-9957-f2cca80a61ac", "content-length": "26", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} })
77192025-01-25T00:22:18.791ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77202025-01-25T00:22:18.791ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77212025-01-25T00:22:18.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77222025-01-25T00:22:18.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77232025-01-25T00:22:18.793ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77242025-01-25T00:22:18.807ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
77252025-01-25T00:22:18.807ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77262025-01-25T00:22:18.807ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "80e1400b-0fe5-42a8-b718-e5fbca0e7be2", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} })
77272025-01-25T00:22:18.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77282025-01-25T00:22:18.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77292025-01-25T00:22:18.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77302025-01-25T00:22:18.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77312025-01-25T00:22:18.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77322025-01-25T00:22:18.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77332025-01-25T00:22:18.824ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
77342025-01-25T00:22:18.824ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77352025-01-25T00:22:18.825ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "df4c9fd7-edf7-4273-b20b-cb6e618f5862", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} })
77362025-01-25T00:22:18.827ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 403.350991ms iteration = 26 status = {}
77372025-01-25T00:22:18.829ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
77382025-01-25T00:22:18.841ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77392025-01-25T00:22:18.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77402025-01-25T00:22:18.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77412025-01-25T00:22:18.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77422025-01-25T00:22:18.884ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
77432025-01-25T00:22:18.884ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8ca18617-763b-4d65-9aba-b9839dc6bb2f", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77442025-01-25T00:22:18.884ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77452025-01-25T00:22:18.887ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b1010f6d-21f8-4070-9175-11e28013167a", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77462025-01-25T00:22:18.887ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77472025-01-25T00:22:18.890ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77482025-01-25T00:22:18.890ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 468.248687ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
77492025-01-25T00:22:18.935ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77502025-01-25T00:22:18.936ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1abb22c-a281-478b-b8b5-3fabf64afb4e", "content-length": "2", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} })
77512025-01-25T00:22:18.938ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77522025-01-25T00:22:18.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77532025-01-25T00:22:18.942ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 519.207364ms iteration = 25 status = null
77542025-01-25T00:22:18.969ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 546.867787ms iteration = 25 status = {}
77552025-01-25T00:22:18.978ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
77562025-01-25T00:22:18.978ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0ad95dec-62f7-48e2-b5e4-39478eade365", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
77572025-01-25T00:22:18.978ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
77582025-01-25T00:22:18.981ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "eb09abae-0d6b-47c6-9302-b760fce3464d", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
77592025-01-25T00:22:18.981ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
77602025-01-25T00:22:18.983ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2c4f64a3-c49c-46a8-9161-4f4d5fc4de66", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
77612025-01-25T00:22:18.983ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
77622025-01-25T00:22:18.985ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
77632025-01-25T00:22:18.985ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 563.041541ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
77642025-01-25T00:22:18.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 49005de0-6898-4b4f-8e92-1d92159ced9a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
77652025-01-25T00:22:18.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 49005de0-6898-4b4f-8e92-1d92159ced9a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
77662025-01-25T00:22:19.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77672025-01-25T00:22:19.017ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "43f481d9-0b3e-44b5-a474-d2586319b126", "content-length": "691", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} })
77682025-01-25T00:22:19.017ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
77692025-01-25T00:22:19.017ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
77702025-01-25T00:22:19.017ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
77712025-01-25T00:22:19.018ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 595.709091ms iteration = 26 status = {}
77722025-01-25T00:22:19.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 49005de0-6898-4b4f-8e92-1d92159ced9a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
77732025-01-25T00:22:19.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77742025-01-25T00:22:19.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77752025-01-25T00:22:19.041ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
77762025-01-25T00:22:19.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77772025-01-25T00:22:19.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77782025-01-25T00:22:19.051ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77792025-01-25T00:22:19.051ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "18e4c5c2-7a97-4f4e-9229-d6ed19550677", "content-length": "134", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} })
77802025-01-25T00:22:19.051ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77812025-01-25T00:22:19.051ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
77822025-01-25T00:22:19.052ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77832025-01-25T00:22:19.052ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77842025-01-25T00:22:19.052ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77852025-01-25T00:22:19.052ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77862025-01-25T00:22:19.052ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77872025-01-25T00:22:19.052ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77882025-01-25T00:22:19.052ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77892025-01-25T00:22:19.052ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77902025-01-25T00:22:19.052ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
77912025-01-25T00:22:19.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77922025-01-25T00:22:19.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77932025-01-25T00:22:19.054ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77942025-01-25T00:22:19.054ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "24ab0340-7674-4a7c-ab4e-7811aab6060c", "content-length": "2", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} })
77952025-01-25T00:22:19.054ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
77962025-01-25T00:22:19.055ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d652365-5c40-4629-9c4e-e7665382bfb0", "content-length": "52", "date": "Sat, 25 Jan 2025 00:22:19 GMT"} })
77972025-01-25T00:22:19.055ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
77982025-01-25T00:22:19.055ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
77992025-01-25T00:22:19.158ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e1f85abb-6c69-4e80-a559-0177012e09d0", "date": "Sat, 25 Jan 2025 00:22:18 GMT"} })
78002025-01-25T00:22:19.158ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
78012025-01-25T00:22:19.158ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78022025-01-25T00:22:19.162ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "96f0683a-6427-44a8-a0fe-f421d50f57c0", "content-length": "682", "date": "Sat, 25 Jan 2025 00:22:19 GMT"} })
78032025-01-25T00:22:19.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78042025-01-25T00:22:19.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78052025-01-25T00:22:19.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78062025-01-25T00:22:19.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78072025-01-25T00:22:19.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78082025-01-25T00:22:19.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78092025-01-25T00:22:19.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78102025-01-25T00:22:19.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78112025-01-25T00:22:19.181ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 758.328619ms iteration = 25 status = {}
78122025-01-25T00:22:20.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cf2ffcde-fa8d-40f8-a6c2-e46b28d74904 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78132025-01-25T00:22:20.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cf2ffcde-fa8d-40f8-a6c2-e46b28d74904 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78142025-01-25T00:22:20.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cf2ffcde-fa8d-40f8-a6c2-e46b28d74904 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78152025-01-25T00:22:20.986ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 540 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = dffc2e73-4877-40c2-b019-56f106cbdf8b response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
78162025-01-25T00:22:21.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4aa2297a-1d87-4944-94ec-0f8243b3f432 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78172025-01-25T00:22:21.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4aa2297a-1d87-4944-94ec-0f8243b3f432 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78182025-01-25T00:22:21.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 4aa2297a-1d87-4944-94ec-0f8243b3f432 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78192025-01-25T00:22:22.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 810b2ca6-3aff-4aa7-9920-4a9003c04cc8 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78202025-01-25T00:22:22.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 810b2ca6-3aff-4aa7-9920-4a9003c04cc8 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78212025-01-25T00:22:22.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 810b2ca6-3aff-4aa7-9920-4a9003c04cc8 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78222025-01-25T00:22:23.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dbf93f03-9996-4bb6-9328-ae426d70c392 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78232025-01-25T00:22:23.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dbf93f03-9996-4bb6-9328-ae426d70c392 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78242025-01-25T00:22:23.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2766 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = dbf93f03-9996-4bb6-9328-ae426d70c392 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78252025-01-25T00:22:24.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5204fe8b-a9de-4971-a9f4-24caba76a671 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78262025-01-25T00:22:24.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5204fe8b-a9de-4971-a9f4-24caba76a671 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78272025-01-25T00:22:24.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5204fe8b-a9de-4971-a9f4-24caba76a671 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78282025-01-25T00:22:25.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3fcbf784-214c-476f-acdd-5de703e2e128 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78292025-01-25T00:22:25.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3fcbf784-214c-476f-acdd-5de703e2e128 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78302025-01-25T00:22:25.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3fcbf784-214c-476f-acdd-5de703e2e128 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78312025-01-25T00:22:25.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 25be6296-d587-454a-9b08-eeef53eacef3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
78322025-01-25T00:22:25.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 25be6296-d587-454a-9b08-eeef53eacef3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
78332025-01-25T00:22:25.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 25be6296-d587-454a-9b08-eeef53eacef3 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
78342025-01-25T00:22:26.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 29f98c44-d2ac-4ede-a97f-bf2e418d081c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78352025-01-25T00:22:26.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 29f98c44-d2ac-4ede-a97f-bf2e418d081c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78362025-01-25T00:22:26.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 29f98c44-d2ac-4ede-a97f-bf2e418d081c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78372025-01-25T00:22:27.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b9bfa35-0ab5-4112-ac89-3fdded9f6196 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78382025-01-25T00:22:27.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b9bfa35-0ab5-4112-ac89-3fdded9f6196 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78392025-01-25T00:22:27.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b9bfa35-0ab5-4112-ac89-3fdded9f6196 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78402025-01-25T00:22:28.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a2d34330-f605-416c-9b24-350533ca214c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78412025-01-25T00:22:28.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a2d34330-f605-416c-9b24-350533ca214c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78422025-01-25T00:22:28.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a2d34330-f605-416c-9b24-350533ca214c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78432025-01-25T00:22:28.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
78442025-01-25T00:22:28.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78452025-01-25T00:22:28.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78462025-01-25T00:22:28.424ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
78472025-01-25T00:22:28.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78482025-01-25T00:22:28.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78492025-01-25T00:22:28.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78502025-01-25T00:22:28.426ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78512025-01-25T00:22:28.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78522025-01-25T00:22:28.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78532025-01-25T00:22:28.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78542025-01-25T00:22:28.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78552025-01-25T00:22:28.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.186642ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78562025-01-25T00:22:28.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78572025-01-25T00:22:28.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78582025-01-25T00:22:28.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78592025-01-25T00:22:28.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
78602025-01-25T00:22:28.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78612025-01-25T00:22:28.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78622025-01-25T00:22:28.442ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
78632025-01-25T00:22:28.442ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.041984ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
78642025-01-25T00:22:29.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8e67f2d8-babd-48cf-96a3-38987c9b1877 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78652025-01-25T00:22:29.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8e67f2d8-babd-48cf-96a3-38987c9b1877 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78662025-01-25T00:22:29.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8e67f2d8-babd-48cf-96a3-38987c9b1877 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78672025-01-25T00:22:30.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 35d73162-d04b-4b35-bc05-18dfdbeef21a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78682025-01-25T00:22:30.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 35d73162-d04b-4b35-bc05-18dfdbeef21a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78692025-01-25T00:22:30.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 35d73162-d04b-4b35-bc05-18dfdbeef21a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78702025-01-25T00:22:30.987ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 523 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = cdc20f1b-fad8-4cbf-ba23-8e3e2303d8d9 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
78712025-01-25T00:22:31.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d5445c10-7b8a-4b72-996f-e2142be9ce9f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78722025-01-25T00:22:31.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d5445c10-7b8a-4b72-996f-e2142be9ce9f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78732025-01-25T00:22:31.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d5445c10-7b8a-4b72-996f-e2142be9ce9f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78742025-01-25T00:22:32.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c9f265de-22c7-49ec-990c-6f9358bebc0a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78752025-01-25T00:22:32.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c9f265de-22c7-49ec-990c-6f9358bebc0a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78762025-01-25T00:22:32.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c9f265de-22c7-49ec-990c-6f9358bebc0a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78772025-01-25T00:22:33.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b1189db0-29fd-4a99-bd9c-ebd2a35b57c0 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78782025-01-25T00:22:33.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b1189db0-29fd-4a99-bd9c-ebd2a35b57c0 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78792025-01-25T00:22:33.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b1189db0-29fd-4a99-bd9c-ebd2a35b57c0 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78802025-01-25T00:22:34.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a2c2d6f6-3a25-4946-a511-f9704e46192c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78812025-01-25T00:22:34.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a2c2d6f6-3a25-4946-a511-f9704e46192c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78822025-01-25T00:22:34.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a2c2d6f6-3a25-4946-a511-f9704e46192c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78832025-01-25T00:22:35.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 50acdb94-b0e4-4484-9ddb-e37bed2e033f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78842025-01-25T00:22:35.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 50acdb94-b0e4-4484-9ddb-e37bed2e033f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78852025-01-25T00:22:35.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 50acdb94-b0e4-4484-9ddb-e37bed2e033f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78862025-01-25T00:22:36.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7ea9703e-336a-489c-97c7-994dfe034b26 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78872025-01-25T00:22:36.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7ea9703e-336a-489c-97c7-994dfe034b26 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78882025-01-25T00:22:36.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7ea9703e-336a-489c-97c7-994dfe034b26 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78892025-01-25T00:22:37.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7959c543-e1be-4fed-860b-72eb38a3f057 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78902025-01-25T00:22:37.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7959c543-e1be-4fed-860b-72eb38a3f057 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78912025-01-25T00:22:37.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7959c543-e1be-4fed-860b-72eb38a3f057 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
78922025-01-25T00:22:38.423ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
78932025-01-25T00:22:38.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78942025-01-25T00:22:38.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78952025-01-25T00:22:38.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
78962025-01-25T00:22:38.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78972025-01-25T00:22:38.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78982025-01-25T00:22:38.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78992025-01-25T00:22:38.426ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79002025-01-25T00:22:38.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79012025-01-25T00:22:38.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.041081ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79022025-01-25T00:22:38.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79032025-01-25T00:22:38.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79042025-01-25T00:22:38.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79052025-01-25T00:22:38.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79062025-01-25T00:22:38.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79072025-01-25T00:22:38.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79082025-01-25T00:22:38.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ea94d62b-5eca-46e6-b20b-2ac44a090af3 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79092025-01-25T00:22:38.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ea94d62b-5eca-46e6-b20b-2ac44a090af3 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79102025-01-25T00:22:38.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
79112025-01-25T00:22:38.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79122025-01-25T00:22:38.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79132025-01-25T00:22:38.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ea94d62b-5eca-46e6-b20b-2ac44a090af3 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79142025-01-25T00:22:38.447ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
79152025-01-25T00:22:38.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.142045ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
79162025-01-25T00:22:39.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c338c3e0-e8a2-4cff-bcb3-ec28293e009e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79172025-01-25T00:22:39.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c338c3e0-e8a2-4cff-bcb3-ec28293e009e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79182025-01-25T00:22:39.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c338c3e0-e8a2-4cff-bcb3-ec28293e009e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79192025-01-25T00:22:40.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0cac3a72-aa3f-4bbb-8d3f-b232efe60a5b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79202025-01-25T00:22:40.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0cac3a72-aa3f-4bbb-8d3f-b232efe60a5b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79212025-01-25T00:22:40.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0cac3a72-aa3f-4bbb-8d3f-b232efe60a5b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79222025-01-25T00:22:40.987ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 618 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 0244d4ab-c68a-45ce-925a-b55fee4afb49 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
79232025-01-25T00:22:41.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fa3a790b-8a1c-404f-ba2d-5d16b949509c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79242025-01-25T00:22:41.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fa3a790b-8a1c-404f-ba2d-5d16b949509c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79252025-01-25T00:22:41.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fa3a790b-8a1c-404f-ba2d-5d16b949509c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79262025-01-25T00:22:42.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 94db8b2e-03c8-4a28-9fa1-1b91b6d42321 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79272025-01-25T00:22:42.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 94db8b2e-03c8-4a28-9fa1-1b91b6d42321 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79282025-01-25T00:22:42.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 94db8b2e-03c8-4a28-9fa1-1b91b6d42321 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79292025-01-25T00:22:43.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b2f7abe1-078b-4f47-9f64-0aa9d7c43e2b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79302025-01-25T00:22:43.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b2f7abe1-078b-4f47-9f64-0aa9d7c43e2b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79312025-01-25T00:22:43.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2605 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b2f7abe1-078b-4f47-9f64-0aa9d7c43e2b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79322025-01-25T00:22:44.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7983d631-7399-439c-b0c3-6245f9695b4a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79332025-01-25T00:22:44.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7983d631-7399-439c-b0c3-6245f9695b4a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79342025-01-25T00:22:44.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7983d631-7399-439c-b0c3-6245f9695b4a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79352025-01-25T00:22:45.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 601c4fe9-7df1-4401-a5dd-e18a40f87ad1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79362025-01-25T00:22:45.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 601c4fe9-7df1-4401-a5dd-e18a40f87ad1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79372025-01-25T00:22:45.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 601c4fe9-7df1-4401-a5dd-e18a40f87ad1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79382025-01-25T00:22:46.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8e60061d-d40b-4e8b-bbd8-64e48c893dca roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79392025-01-25T00:22:46.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8e60061d-d40b-4e8b-bbd8-64e48c893dca resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79402025-01-25T00:22:46.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8e60061d-d40b-4e8b-bbd8-64e48c893dca response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79412025-01-25T00:22:47.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e15e1f85-c6af-4a2a-bfb9-994aa8e5492f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79422025-01-25T00:22:47.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e15e1f85-c6af-4a2a-bfb9-994aa8e5492f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79432025-01-25T00:22:47.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e15e1f85-c6af-4a2a-bfb9-994aa8e5492f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
79442025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
79452025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
79462025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79472025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
79482025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79492025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
79502025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79512025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79522025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
79532025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
79542025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
79552025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79562025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
79572025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79582025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79592025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
79602025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79612025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
79622025-01-25T00:22:48.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79632025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79642025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79652025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79662025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79672025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79682025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79692025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79702025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79712025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79722025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
79732025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
79742025-01-25T00:22:48.424ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
79752025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
79762025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79772025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79782025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
79792025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79802025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
79812025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79822025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
79832025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79842025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
79852025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79862025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
79872025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79882025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
79892025-01-25T00:22:48.424ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
79902025-01-25T00:22:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79912025-01-25T00:22:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79922025-01-25T00:22:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
79932025-01-25T00:22:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79942025-01-25T00:22:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79952025-01-25T00:22:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79962025-01-25T00:22:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
79972025-01-25T00:22:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79982025-01-25T00:22:48.426ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79992025-01-25T00:22:48.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80002025-01-25T00:22:48.427ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1691, tv_nsec: 144135096 } })
80012025-01-25T00:22:48.428ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
80022025-01-25T00:22:48.428ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.546944ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80032025-01-25T00:22:48.428ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1691, tv_nsec: 144987660 } })
80042025-01-25T00:22:48.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
80052025-01-25T00:22:48.428ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80062025-01-25T00:22:48.428ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
80072025-01-25T00:22:48.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80082025-01-25T00:22:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80092025-01-25T00:22:48.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80102025-01-25T00:22:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80112025-01-25T00:22:48.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80122025-01-25T00:22:48.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80132025-01-25T00:22:48.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80142025-01-25T00:22:48.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80152025-01-25T00:22:48.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80162025-01-25T00:22:48.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80172025-01-25T00:22:48.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80182025-01-25T00:22:48.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80192025-01-25T00:22:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80202025-01-25T00:22:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80212025-01-25T00:22:48.443ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80222025-01-25T00:22:48.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80232025-01-25T00:22:48.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80242025-01-25T00:22:48.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80252025-01-25T00:22:48.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80262025-01-25T00:22:48.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80272025-01-25T00:22:48.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80282025-01-25T00:22:48.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80292025-01-25T00:22:48.474ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80302025-01-25T00:22:48.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80312025-01-25T00:22:48.476ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80322025-01-25T00:22:48.476ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80332025-01-25T00:22:48.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80342025-01-25T00:22:48.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80352025-01-25T00:22:48.477ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.600663ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80362025-01-25T00:22:48.479ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80372025-01-25T00:22:48.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80382025-01-25T00:22:48.482ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80392025-01-25T00:22:48.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80402025-01-25T00:22:48.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.196939ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
80412025-01-25T00:22:48.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80422025-01-25T00:22:48.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80432025-01-25T00:22:48.487ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80442025-01-25T00:22:48.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80452025-01-25T00:22:48.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80462025-01-25T00:22:48.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80472025-01-25T00:22:48.489ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80482025-01-25T00:22:48.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80492025-01-25T00:22:48.490ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80502025-01-25T00:22:48.490ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
80512025-01-25T00:22:48.490ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80522025-01-25T00:22:48.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80532025-01-25T00:22:48.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80542025-01-25T00:22:48.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.518436ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
80552025-01-25T00:22:48.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
80562025-01-25T00:22:48.492ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80572025-01-25T00:22:48.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80582025-01-25T00:22:48.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80592025-01-25T00:22:48.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80602025-01-25T00:22:48.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80612025-01-25T00:22:48.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80622025-01-25T00:22:48.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
80632025-01-25T00:22:48.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80642025-01-25T00:22:48.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80652025-01-25T00:22:48.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80662025-01-25T00:22:48.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80672025-01-25T00:22:48.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80682025-01-25T00:22:48.501ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 78.140967ms iteration = 26 status = 0
80692025-01-25T00:22:48.503ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80702025-01-25T00:22:48.503ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.570809ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80712025-01-25T00:22:48.504ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80722025-01-25T00:22:48.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80732025-01-25T00:22:48.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80742025-01-25T00:22:48.506ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1691, tv_nsec: 223279428 } })
80752025-01-25T00:22:48.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80762025-01-25T00:22:48.507ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
80772025-01-25T00:22:48.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80782025-01-25T00:22:48.507ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
80792025-01-25T00:22:48.507ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80802025-01-25T00:22:48.508ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "72789fb6-0cd0-4deb-98c2-78680de7bb8f", "content-length": "26", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
80812025-01-25T00:22:48.508ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80822025-01-25T00:22:48.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80832025-01-25T00:22:48.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80842025-01-25T00:22:48.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80852025-01-25T00:22:48.509ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80862025-01-25T00:22:48.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80872025-01-25T00:22:48.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
80882025-01-25T00:22:48.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80892025-01-25T00:22:48.514ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
80902025-01-25T00:22:48.514ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80912025-01-25T00:22:48.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80922025-01-25T00:22:48.514ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ca87be2-35e4-4466-86ef-329e14926e86", "content-length": "26", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
80932025-01-25T00:22:48.514ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80942025-01-25T00:22:48.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80952025-01-25T00:22:48.530ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80962025-01-25T00:22:48.530ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80972025-01-25T00:22:48.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80982025-01-25T00:22:48.530ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
80992025-01-25T00:22:48.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.934757ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
81002025-01-25T00:22:48.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81012025-01-25T00:22:48.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.401736ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81022025-01-25T00:22:48.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81032025-01-25T00:22:48.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81042025-01-25T00:22:48.549ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
81052025-01-25T00:22:48.549ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 125.618534ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
81062025-01-25T00:22:48.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 129.959026ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81072025-01-25T00:22:48.562ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81082025-01-25T00:22:48.562ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81092025-01-25T00:22:48.562ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.260525ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81102025-01-25T00:22:48.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 145.857369ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
81112025-01-25T00:22:48.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81122025-01-25T00:22:48.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81132025-01-25T00:22:48.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81142025-01-25T00:22:48.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81152025-01-25T00:22:48.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81162025-01-25T00:22:48.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81172025-01-25T00:22:48.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81182025-01-25T00:22:48.585ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81192025-01-25T00:22:48.586ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b948f276-436b-4bdd-a060-4b721a09fb83", "content-length": "2", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
81202025-01-25T00:22:48.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81212025-01-25T00:22:48.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81222025-01-25T00:22:48.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81232025-01-25T00:22:48.587ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81242025-01-25T00:22:48.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81252025-01-25T00:22:48.590ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 166.576478ms iteration = 26 status = null
81262025-01-25T00:22:48.627ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 203.317638ms iteration = 29 status = {"physical_disks_added":0}
81272025-01-25T00:22:48.642ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
81282025-01-25T00:22:48.642ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81292025-01-25T00:22:48.643ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8543799c-5851-4846-93cd-951582109e33", "content-length": "26", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
81302025-01-25T00:22:48.643ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81312025-01-25T00:22:48.645ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
81322025-01-25T00:22:48.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 846dfcbf-b27e-4e3d-a504-074a43879f5c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
81332025-01-25T00:22:48.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 846dfcbf-b27e-4e3d-a504-074a43879f5c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
81342025-01-25T00:22:48.682ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81352025-01-25T00:22:48.682ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81362025-01-25T00:22:48.682ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d256584d-518e-4a2a-a64e-fb69e5947ec3", "content-length": "372", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
81372025-01-25T00:22:48.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81382025-01-25T00:22:48.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81392025-01-25T00:22:48.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 846dfcbf-b27e-4e3d-a504-074a43879f5c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
81402025-01-25T00:22:48.746ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 323.229053ms iteration = 26 status = {}
81412025-01-25T00:22:48.843ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81422025-01-25T00:22:48.876ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d031855-d4b0-4a60-acde-8a34ed780398", "content-length": "691", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
81432025-01-25T00:22:48.876ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
81442025-01-25T00:22:48.876ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
81452025-01-25T00:22:48.876ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
81462025-01-25T00:22:48.878ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 454.541826ms iteration = 27 status = {}
81472025-01-25T00:22:48.901ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
81482025-01-25T00:22:48.901ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81492025-01-25T00:22:48.901ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b51339d2-9c6b-42d3-a45d-530bc6baf4df", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
81502025-01-25T00:22:48.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81512025-01-25T00:22:48.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81522025-01-25T00:22:48.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81532025-01-25T00:22:48.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81542025-01-25T00:22:48.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81552025-01-25T00:22:48.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81562025-01-25T00:22:48.911ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81572025-01-25T00:22:48.911ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81582025-01-25T00:22:48.911ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a58c2c62-6f10-45b3-a5ba-efeb767d2fbf", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
81592025-01-25T00:22:48.913ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 488.523364ms iteration = 27 status = {}
81602025-01-25T00:22:48.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81612025-01-25T00:22:48.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81622025-01-25T00:22:48.921ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
81632025-01-25T00:22:48.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81642025-01-25T00:22:48.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81652025-01-25T00:22:48.931ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81662025-01-25T00:22:48.931ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "40fc81a4-11c5-435a-9f99-818a65f1cbdb", "content-length": "134", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
81672025-01-25T00:22:48.931ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81682025-01-25T00:22:48.931ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
81692025-01-25T00:22:48.931ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81702025-01-25T00:22:48.931ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81712025-01-25T00:22:48.931ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81722025-01-25T00:22:48.931ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81732025-01-25T00:22:48.931ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81742025-01-25T00:22:48.931ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81752025-01-25T00:22:48.931ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81762025-01-25T00:22:48.931ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81772025-01-25T00:22:48.932ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
81782025-01-25T00:22:48.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81792025-01-25T00:22:48.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81802025-01-25T00:22:48.934ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81812025-01-25T00:22:48.934ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "70cebe5d-39a5-4b2c-9234-cd9323469108", "content-length": "2", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
81822025-01-25T00:22:48.934ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81832025-01-25T00:22:48.934ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "36bff3ab-38b5-4618-a17c-07cef8e1d6e5", "content-length": "52", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
81842025-01-25T00:22:48.934ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
81852025-01-25T00:22:48.934ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81862025-01-25T00:22:49.033ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "63c1ea2d-74ba-4b9e-b7c3-83ba923b2d51", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
81872025-01-25T00:22:49.033ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
81882025-01-25T00:22:49.033ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81892025-01-25T00:22:49.033ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a52e0ca-dc7a-4cb0-999f-062f3be22cb9", "content-length": "682", "date": "Sat, 25 Jan 2025 00:22:48 GMT"} })
81902025-01-25T00:22:49.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81912025-01-25T00:22:49.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81922025-01-25T00:22:49.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81932025-01-25T00:22:49.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81942025-01-25T00:22:49.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81952025-01-25T00:22:49.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81962025-01-25T00:22:49.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81972025-01-25T00:22:49.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81982025-01-25T00:22:49.050ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 626.368421ms iteration = 26 status = {}
81992025-01-25T00:22:49.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 07dac5c5-dbde-49e8-b11d-365b060136fd roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82002025-01-25T00:22:49.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 07dac5c5-dbde-49e8-b11d-365b060136fd resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82012025-01-25T00:22:49.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 07dac5c5-dbde-49e8-b11d-365b060136fd response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82022025-01-25T00:22:50.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5b106528-98f8-4576-828b-6c39d93a3ae3 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82032025-01-25T00:22:50.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5b106528-98f8-4576-828b-6c39d93a3ae3 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82042025-01-25T00:22:50.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5b106528-98f8-4576-828b-6c39d93a3ae3 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82052025-01-25T00:22:50.987ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 537 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = fca0a34f-83b2-46f3-86ed-ae4e4eaba374 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
82062025-01-25T00:22:51.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 22ec96c4-cfa1-43d8-a328-86fa1bea0da4 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82072025-01-25T00:22:51.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 22ec96c4-cfa1-43d8-a328-86fa1bea0da4 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82082025-01-25T00:22:51.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 22ec96c4-cfa1-43d8-a328-86fa1bea0da4 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82092025-01-25T00:22:52.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c11e3788-1262-47f5-bc09-15d2aa74c05d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82102025-01-25T00:22:52.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c11e3788-1262-47f5-bc09-15d2aa74c05d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82112025-01-25T00:22:52.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = c11e3788-1262-47f5-bc09-15d2aa74c05d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82122025-01-25T00:22:53.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a927b76-245d-4127-9cfc-1d9062416fd5 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82132025-01-25T00:22:53.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a927b76-245d-4127-9cfc-1d9062416fd5 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82142025-01-25T00:22:53.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a927b76-245d-4127-9cfc-1d9062416fd5 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82152025-01-25T00:22:54.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f56e3ff1-e756-4573-b7b8-ed70b1f8266a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82162025-01-25T00:22:54.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f56e3ff1-e756-4573-b7b8-ed70b1f8266a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82172025-01-25T00:22:54.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f56e3ff1-e756-4573-b7b8-ed70b1f8266a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82182025-01-25T00:22:55.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f91aed09-d00c-4c7c-a101-cc9fe936a3d3 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82192025-01-25T00:22:55.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f91aed09-d00c-4c7c-a101-cc9fe936a3d3 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82202025-01-25T00:22:55.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f91aed09-d00c-4c7c-a101-cc9fe936a3d3 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82212025-01-25T00:22:55.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 5f2c4909-44af-4887-8a46-fd97ab29dbe8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
82222025-01-25T00:22:55.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 5f2c4909-44af-4887-8a46-fd97ab29dbe8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
82232025-01-25T00:22:55.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 5f2c4909-44af-4887-8a46-fd97ab29dbe8 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
82242025-01-25T00:22:56.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 885cfc2e-116f-49ba-851d-dfb55b0b116d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82252025-01-25T00:22:56.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 885cfc2e-116f-49ba-851d-dfb55b0b116d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82262025-01-25T00:22:56.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 885cfc2e-116f-49ba-851d-dfb55b0b116d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82272025-01-25T00:22:57.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = eca0ca85-7009-4eeb-a955-de3577d749a9 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82282025-01-25T00:22:57.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = eca0ca85-7009-4eeb-a955-de3577d749a9 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82292025-01-25T00:22:57.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = eca0ca85-7009-4eeb-a955-de3577d749a9 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82302025-01-25T00:22:58.424ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
82312025-01-25T00:22:58.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82322025-01-25T00:22:58.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82332025-01-25T00:22:58.424ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
82342025-01-25T00:22:58.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82352025-01-25T00:22:58.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82362025-01-25T00:22:58.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82372025-01-25T00:22:58.426ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82382025-01-25T00:22:58.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82392025-01-25T00:22:58.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82402025-01-25T00:22:58.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82412025-01-25T00:22:58.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82422025-01-25T00:22:58.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82432025-01-25T00:22:58.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82442025-01-25T00:22:58.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82452025-01-25T00:22:58.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
82462025-01-25T00:22:58.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82472025-01-25T00:22:58.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82482025-01-25T00:22:58.447ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
82492025-01-25T00:22:58.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.02973ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
82502025-01-25T00:22:58.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.258358ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82512025-01-25T00:22:58.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 93ef0177-c653-4247-b5b8-63ee7c3df21a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82522025-01-25T00:22:58.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 93ef0177-c653-4247-b5b8-63ee7c3df21a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82532025-01-25T00:22:58.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 93ef0177-c653-4247-b5b8-63ee7c3df21a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82542025-01-25T00:22:59.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b08b194-aa9e-4671-969e-30df34c27dbd roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82552025-01-25T00:22:59.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b08b194-aa9e-4671-969e-30df34c27dbd resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82562025-01-25T00:22:59.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1b08b194-aa9e-4671-969e-30df34c27dbd response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82572025-01-25T00:23:00.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ebda7b92-3356-48b8-928b-7bf7042c121d roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82582025-01-25T00:23:00.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ebda7b92-3356-48b8-928b-7bf7042c121d resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82592025-01-25T00:23:00.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ebda7b92-3356-48b8-928b-7bf7042c121d response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82602025-01-25T00:23:00.987ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 547 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 7f77a7ca-6f3a-43f2-967a-2e2076371a51 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
82612025-01-25T00:23:01.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 053337fb-d47c-45c8-a77c-098f7ab06084 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82622025-01-25T00:23:01.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 053337fb-d47c-45c8-a77c-098f7ab06084 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82632025-01-25T00:23:01.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 053337fb-d47c-45c8-a77c-098f7ab06084 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82642025-01-25T00:23:02.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bab6b853-ec21-4d19-8e39-26fdfb715034 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82652025-01-25T00:23:02.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bab6b853-ec21-4d19-8e39-26fdfb715034 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82662025-01-25T00:23:02.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = bab6b853-ec21-4d19-8e39-26fdfb715034 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82672025-01-25T00:23:04.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 64b512b2-6692-4a24-b71a-b64e34a4d0ce roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82682025-01-25T00:23:04.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 64b512b2-6692-4a24-b71a-b64e34a4d0ce resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82692025-01-25T00:23:04.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 64b512b2-6692-4a24-b71a-b64e34a4d0ce response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82702025-01-25T00:23:05.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5abeb24d-439b-4da3-8660-52a7c62aeb65 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82712025-01-25T00:23:05.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5abeb24d-439b-4da3-8660-52a7c62aeb65 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82722025-01-25T00:23:05.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5abeb24d-439b-4da3-8660-52a7c62aeb65 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82732025-01-25T00:23:06.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 51956a65-541f-40d7-b0db-e89e2bc51e27 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82742025-01-25T00:23:06.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 51956a65-541f-40d7-b0db-e89e2bc51e27 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82752025-01-25T00:23:06.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 51956a65-541f-40d7-b0db-e89e2bc51e27 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82762025-01-25T00:23:07.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 80d7c914-53fe-41e0-90af-c5660a749608 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82772025-01-25T00:23:07.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 80d7c914-53fe-41e0-90af-c5660a749608 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82782025-01-25T00:23:07.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 80d7c914-53fe-41e0-90af-c5660a749608 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82792025-01-25T00:23:08.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0b883ca9-3224-4f32-be2e-0105b750feae roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82802025-01-25T00:23:08.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0b883ca9-3224-4f32-be2e-0105b750feae resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82812025-01-25T00:23:08.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0b883ca9-3224-4f32-be2e-0105b750feae response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
82822025-01-25T00:23:08.423ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
82832025-01-25T00:23:08.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82842025-01-25T00:23:08.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82852025-01-25T00:23:08.425ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
82862025-01-25T00:23:08.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82872025-01-25T00:23:08.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82882025-01-25T00:23:08.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82892025-01-25T00:23:08.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82902025-01-25T00:23:08.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82912025-01-25T00:23:08.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.486098ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82922025-01-25T00:23:08.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82932025-01-25T00:23:08.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82942025-01-25T00:23:08.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82952025-01-25T00:23:08.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82962025-01-25T00:23:08.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82972025-01-25T00:23:08.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82982025-01-25T00:23:08.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
82992025-01-25T00:23:08.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83002025-01-25T00:23:08.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83012025-01-25T00:23:08.448ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
83022025-01-25T00:23:08.448ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.760779ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
83032025-01-25T00:23:09.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 876786b1-3003-4733-9037-d56ed7ce5a1b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83042025-01-25T00:23:09.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 876786b1-3003-4733-9037-d56ed7ce5a1b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83052025-01-25T00:23:09.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 876786b1-3003-4733-9037-d56ed7ce5a1b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83062025-01-25T00:23:10.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 224fc290-47a6-4f01-a8a3-245d03372a17 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83072025-01-25T00:23:10.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 224fc290-47a6-4f01-a8a3-245d03372a17 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83082025-01-25T00:23:10.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 224fc290-47a6-4f01-a8a3-245d03372a17 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83092025-01-25T00:23:10.988ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 919 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 51c16305-545d-4b70-8f62-2d15923acb54 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
83102025-01-25T00:23:11.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3f6f6477-aea2-4a16-82a8-a1ea58206e46 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83112025-01-25T00:23:11.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3f6f6477-aea2-4a16-82a8-a1ea58206e46 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83122025-01-25T00:23:11.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3f6f6477-aea2-4a16-82a8-a1ea58206e46 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83132025-01-25T00:23:12.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f43ff49c-19ba-4b44-a2e2-6429b2954b77 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83142025-01-25T00:23:12.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f43ff49c-19ba-4b44-a2e2-6429b2954b77 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83152025-01-25T00:23:12.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f43ff49c-19ba-4b44-a2e2-6429b2954b77 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83162025-01-25T00:23:13.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0224ce4-e244-4835-91b0-908eed23eef3 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83172025-01-25T00:23:13.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0224ce4-e244-4835-91b0-908eed23eef3 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83182025-01-25T00:23:13.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e0224ce4-e244-4835-91b0-908eed23eef3 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83192025-01-25T00:23:14.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2e6d1a3e-982d-49bf-83e5-1f8dfbce2972 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83202025-01-25T00:23:14.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2e6d1a3e-982d-49bf-83e5-1f8dfbce2972 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83212025-01-25T00:23:14.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2e6d1a3e-982d-49bf-83e5-1f8dfbce2972 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83222025-01-25T00:23:15.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b768e0c8-93d5-4bf3-9d96-47fd6695ae42 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83232025-01-25T00:23:15.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b768e0c8-93d5-4bf3-9d96-47fd6695ae42 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83242025-01-25T00:23:15.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b768e0c8-93d5-4bf3-9d96-47fd6695ae42 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83252025-01-25T00:23:15.980ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:47970
83262025-01-25T00:23:15.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47970 req_id = 85d356fc-c016-490e-a676-f54d001b31b4 roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
83272025-01-25T00:23:15.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47970 req_id = 85d356fc-c016-490e-a676-f54d001b31b4 resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
83282025-01-25T00:23:15.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47970 req_id = 85d356fc-c016-490e-a676-f54d001b31b4 response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?sort_by=id_ascending
83292025-01-25T00:23:15.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47970 req_id = 65eb4a8d-3455-4db1-b430-c979798db7ea roles = RoleSet { roles: {} } uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
83302025-01-25T00:23:15.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47970 req_id = 65eb4a8d-3455-4db1-b430-c979798db7ea resource = Database result = Ok(()) uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
83312025-01-25T00:23:15.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47970 req_id = 65eb4a8d-3455-4db1-b430-c979798db7ea response_code = 200 uri = /metrics/collectors/512ae8cc-0c00-4148-bad7-ae5dd7be4169/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDM4ZDE0OC0wZThhLTRjNWUtYWYyOC0xYzAxMjNiZTA1MzQifX0%3D
83322025-01-25T00:23:16.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9b4382de-8953-4799-aed5-a04e6f675db1 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83332025-01-25T00:23:16.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9b4382de-8953-4799-aed5-a04e6f675db1 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83342025-01-25T00:23:16.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 9b4382de-8953-4799-aed5-a04e6f675db1 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83352025-01-25T00:23:17.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3959c93a-1462-467b-9c24-2a7c117f692a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83362025-01-25T00:23:17.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3959c93a-1462-467b-9c24-2a7c117f692a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83372025-01-25T00:23:17.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3959c93a-1462-467b-9c24-2a7c117f692a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83382025-01-25T00:23:18.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0a6268ac-e517-415a-8ae3-3639eae19b00 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83392025-01-25T00:23:18.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0a6268ac-e517-415a-8ae3-3639eae19b00 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83402025-01-25T00:23:18.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 0a6268ac-e517-415a-8ae3-3639eae19b00 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
83412025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
83422025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
83432025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
83442025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83452025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
83462025-01-25T00:23:18.424ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2
83472025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.81\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2"}
83482025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
83492025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
83502025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
83512025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83522025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
83532025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83542025-01-25T00:23:18.424ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
83552025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
83562025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83572025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83582025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
83592025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
83602025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
83612025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83622025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83632025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
83642025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83652025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
83662025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
83672025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
83682025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83692025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
83702025-01-25T00:23:18.424ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-25 00:13:18.424490020 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
83712025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
83722025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
83732025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83742025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
83752025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
83762025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83772025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
83782025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
83792025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83802025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83812025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
83822025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
83832025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
83842025-01-25T00:23:18.424ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83852025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
83862025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83872025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83882025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
83892025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83902025-01-25T00:23:18.424ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
83912025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
83922025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83932025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
83942025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83952025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
83962025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
83972025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83982025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83992025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84002025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
84012025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84022025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
84032025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
84042025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
84052025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84062025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84072025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
84082025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84092025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84102025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84112025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84122025-01-25T00:23:18.425ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("167a4f68-f407-48e5-a9a6-22f96a22bf2d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a3a6aa3c-ea79-4881-9aa5-b12ba496f837.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d377aef3-509b-404b-82b1-3ca442fb549b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 141162801 } })
84132025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84142025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84152025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84162025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84172025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84182025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84192025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84202025-01-25T00:23:18.425ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("22685765-7656-499f-8835-1c19f38e16e6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("68669e1f-c764-416e-9078-55cbc772328a.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 141336411 } })
84212025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84222025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
84232025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84242025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84252025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84262025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84272025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84282025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84292025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84302025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
84312025-01-25T00:23:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84322025-01-25T00:23:18.426ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
84332025-01-25T00:23:18.426ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.523158ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
84342025-01-25T00:23:18.426ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
84352025-01-25T00:23:18.426ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.630868ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
84362025-01-25T00:23:18.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84372025-01-25T00:23:18.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84382025-01-25T00:23:18.427ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 143341412 } })
84392025-01-25T00:23:18.427ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
84402025-01-25T00:23:18.427ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.621049ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84412025-01-25T00:23:18.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84422025-01-25T00:23:18.428ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-25 00:13:18.424490020 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
84432025-01-25T00:23:18.428ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.072181ms iteration = 14 status = {"expiration":"2025-01-25T00:13:18.424490020Z","pruned":[]}
84442025-01-25T00:23:18.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84452025-01-25T00:23:18.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84462025-01-25T00:23:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84472025-01-25T00:23:18.431ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84482025-01-25T00:23:18.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84492025-01-25T00:23:18.438ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 154274009 } })
84502025-01-25T00:23:18.438ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
84512025-01-25T00:23:18.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84522025-01-25T00:23:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84532025-01-25T00:23:18.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84542025-01-25T00:23:18.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84552025-01-25T00:23:18.445ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.753158ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
84562025-01-25T00:23:18.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84572025-01-25T00:23:18.447ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84582025-01-25T00:23:18.447ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84592025-01-25T00:23:18.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84602025-01-25T00:23:18.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84612025-01-25T00:23:18.450ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84622025-01-25T00:23:18.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84632025-01-25T00:23:18.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84642025-01-25T00:23:18.450ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
84652025-01-25T00:23:18.450ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
84662025-01-25T00:23:18.450ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 26.041305ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
84672025-01-25T00:23:18.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84682025-01-25T00:23:18.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84692025-01-25T00:23:18.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84702025-01-25T00:23:18.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84712025-01-25T00:23:18.474ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84722025-01-25T00:23:18.474ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84732025-01-25T00:23:18.475ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84742025-01-25T00:23:18.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84752025-01-25T00:23:18.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84762025-01-25T00:23:18.485ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84772025-01-25T00:23:18.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84782025-01-25T00:23:18.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84792025-01-25T00:23:18.496ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84802025-01-25T00:23:18.498ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84812025-01-25T00:23:18.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84822025-01-25T00:23:18.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
84832025-01-25T00:23:18.499ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84842025-01-25T00:23:18.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84852025-01-25T00:23:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
84862025-01-25T00:23:18.501ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84872025-01-25T00:23:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84882025-01-25T00:23:18.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84892025-01-25T00:23:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84902025-01-25T00:23:18.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84912025-01-25T00:23:18.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84922025-01-25T00:23:18.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.174762ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
84932025-01-25T00:23:18.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84942025-01-25T00:23:18.504ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84952025-01-25T00:23:18.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84962025-01-25T00:23:18.508ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84972025-01-25T00:23:18.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.990488ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84982025-01-25T00:23:18.509ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84992025-01-25T00:23:18.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85002025-01-25T00:23:18.510ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 226182973 } })
85012025-01-25T00:23:18.510ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
85022025-01-25T00:23:18.511ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85032025-01-25T00:23:18.511ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85042025-01-25T00:23:18.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85052025-01-25T00:23:18.513ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 88.26392ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
85062025-01-25T00:23:18.513ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85072025-01-25T00:23:18.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85082025-01-25T00:23:18.515ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85092025-01-25T00:23:18.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85102025-01-25T00:23:18.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85112025-01-25T00:23:18.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85122025-01-25T00:23:18.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85132025-01-25T00:23:18.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85142025-01-25T00:23:18.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85152025-01-25T00:23:18.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85162025-01-25T00:23:18.524ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85172025-01-25T00:23:18.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85182025-01-25T00:23:18.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85192025-01-25T00:23:18.526ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
85202025-01-25T00:23:18.526ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
85212025-01-25T00:23:18.526ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
85222025-01-25T00:23:18.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85232025-01-25T00:23:18.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85242025-01-25T00:23:18.526ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85252025-01-25T00:23:18.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85262025-01-25T00:23:18.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85272025-01-25T00:23:18.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85282025-01-25T00:23:18.528ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85292025-01-25T00:23:18.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85302025-01-25T00:23:18.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85312025-01-25T00:23:18.529ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85322025-01-25T00:23:18.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85332025-01-25T00:23:18.531ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85342025-01-25T00:23:18.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85352025-01-25T00:23:18.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85362025-01-25T00:23:18.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85372025-01-25T00:23:18.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85382025-01-25T00:23:18.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85392025-01-25T00:23:18.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85402025-01-25T00:23:18.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
85412025-01-25T00:23:18.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85422025-01-25T00:23:18.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85432025-01-25T00:23:18.558ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 133.736187ms iteration = 27 status = 0
85442025-01-25T00:23:18.565ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
85452025-01-25T00:23:18.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
85462025-01-25T00:23:18.567ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
85472025-01-25T00:23:18.567ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
85482025-01-25T00:23:18.567ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
85492025-01-25T00:23:18.567ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 143.436157ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
85502025-01-25T00:23:18.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85512025-01-25T00:23:18.568ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85522025-01-25T00:23:18.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
85532025-01-25T00:23:18.571ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
85542025-01-25T00:23:18.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
85552025-01-25T00:23:18.574ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
85562025-01-25T00:23:18.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 150.800876ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85572025-01-25T00:23:18.576ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85582025-01-25T00:23:18.576ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85592025-01-25T00:23:18.576ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 152.182843ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85602025-01-25T00:23:18.577ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
85612025-01-25T00:23:18.580ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85622025-01-25T00:23:18.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85632025-01-25T00:23:18.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 157.212208ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85642025-01-25T00:23:18.586ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
85652025-01-25T00:23:18.586ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
85662025-01-25T00:23:18.586ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
85672025-01-25T00:23:18.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85682025-01-25T00:23:18.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85692025-01-25T00:23:18.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85702025-01-25T00:23:18.589ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85712025-01-25T00:23:18.590ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85722025-01-25T00:23:18.590ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85732025-01-25T00:23:18.590ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 166.248246ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85742025-01-25T00:23:18.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85752025-01-25T00:23:18.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85762025-01-25T00:23:18.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85772025-01-25T00:23:18.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85782025-01-25T00:23:18.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85792025-01-25T00:23:18.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85802025-01-25T00:23:18.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
85812025-01-25T00:23:18.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85822025-01-25T00:23:18.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85832025-01-25T00:23:18.600ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
85842025-01-25T00:23:18.600ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85852025-01-25T00:23:18.600ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ecf2925-9d35-4f30-8bfc-5c489cf63d66", "content-length": "26", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
85862025-01-25T00:23:18.600ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85872025-01-25T00:23:18.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85882025-01-25T00:23:18.602ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85892025-01-25T00:23:18.604ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85902025-01-25T00:23:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85912025-01-25T00:23:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
85922025-01-25T00:23:18.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85932025-01-25T00:23:18.605ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
85942025-01-25T00:23:18.605ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 0 version = 2
85952025-01-25T00:23:18.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85962025-01-25T00:23:18.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85972025-01-25T00:23:18.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85982025-01-25T00:23:18.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85992025-01-25T00:23:18.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86002025-01-25T00:23:18.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
86012025-01-25T00:23:18.615ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86022025-01-25T00:23:18.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86032025-01-25T00:23:18.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86042025-01-25T00:23:18.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86052025-01-25T00:23:18.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86062025-01-25T00:23:18.621ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 0c1f5df8-3acc-4a72-b824-573df6245127 dns_zone_name = oxide.test found_so_far = 1 version = 2
86072025-01-25T00:23:18.621ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
86082025-01-25T00:23:18.621ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-25 00:10:47.835608 UTC dns_group = external generation = 2
86092025-01-25T00:23:18.621ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 196.654994ms iteration = 14 status = {"generation":2}
86102025-01-25T00:23:18.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
86112025-01-25T00:23:18.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 198.758245ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
86122025-01-25T00:23:18.626ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
86132025-01-25T00:23:18.626ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 202.475364ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
86142025-01-25T00:23:18.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 214.605877ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
86152025-01-25T00:23:18.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86162025-01-25T00:23:18.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86172025-01-25T00:23:18.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86182025-01-25T00:23:18.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86192025-01-25T00:23:18.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86202025-01-25T00:23:18.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86212025-01-25T00:23:18.645ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86222025-01-25T00:23:18.647ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86232025-01-25T00:23:18.647ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86242025-01-25T00:23:18.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86252025-01-25T00:23:18.651ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
86262025-01-25T00:23:18.651ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
86272025-01-25T00:23:18.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86282025-01-25T00:23:18.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86292025-01-25T00:23:18.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86302025-01-25T00:23:18.655ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
86312025-01-25T00:23:18.655ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86322025-01-25T00:23:18.655ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4af9c2d8-5d2b-4c4b-9c7e-ade87a699305", "content-length": "26", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
86332025-01-25T00:23:18.655ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86342025-01-25T00:23:18.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86352025-01-25T00:23:18.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86362025-01-25T00:23:18.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86372025-01-25T00:23:18.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86382025-01-25T00:23:18.659ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 15273d81-30c1-4ba8-a921-292b70804bab dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
86392025-01-25T00:23:18.659ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
86402025-01-25T00:23:18.659ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-25 00:10:46.879674 UTC dns_group = internal generation = 1
86412025-01-25T00:23:18.659ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 235.412455ms iteration = 14 status = {"generation":1}
86422025-01-25T00:23:18.675ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-25T00:10:16.530962Z, time_modified: 2025-01-25T00:10:16.530962Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fd047cff-047f-41d5-9f37-bd6037bf08d8, db_silo: Silo { identity: SiloIdentity { id: fd047cff-047f-41d5-9f37-bd6037bf08d8, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-25T00:10:47.791969Z, time_modified: 2025-01-25T00:10:47.791969Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6" }] }) }
86432025-01-25T00:23:18.675ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 251.230508ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]}},"default_endpoint":{"silo_id":"fd047cff-047f-41d5-9f37-bd6037bf08d8","tls_certs":["b18e83961972aaf40887f406352560e8ef410ec7012b2f15c475bf4bddeb4bd6"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
86442025-01-25T00:23:18.697ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
86452025-01-25T00:23:18.697ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 272.464228ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
86462025-01-25T00:23:18.707ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 282.584722ms iteration = 30 status = {"physical_disks_added":0}
86472025-01-25T00:23:18.733ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
86482025-01-25T00:23:18.733ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b029dc52-5bb8-4f93-aa86-1df0dc2beb4e", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86492025-01-25T00:23:18.733ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86502025-01-25T00:23:18.734ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9b213fd7-1d4b-4db6-b169-51929e6620f6", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86512025-01-25T00:23:18.734ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86522025-01-25T00:23:18.736ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86532025-01-25T00:23:18.736ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 312.062105ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
86542025-01-25T00:23:18.758ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86552025-01-25T00:23:18.759ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "49252f3b-6392-4c6b-875b-3326f8ee7a9b", "content-length": "2", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
86562025-01-25T00:23:18.762ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86572025-01-25T00:23:18.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86582025-01-25T00:23:18.764ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 340.594554ms iteration = 27 status = null
86592025-01-25T00:23:18.774ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
86602025-01-25T00:23:18.782ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
86612025-01-25T00:23:18.782ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86622025-01-25T00:23:18.782ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "038e1b78-f62d-4f27-98eb-cd3d4013bcf2", "content-length": "26", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
86632025-01-25T00:23:18.782ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86642025-01-25T00:23:18.784ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
86652025-01-25T00:23:18.805ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 381.324175ms iteration = 27 status = {}
86662025-01-25T00:23:18.805ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86672025-01-25T00:23:18.806ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86682025-01-25T00:23:18.806ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf22f13c-210d-4ac8-9bfa-78ff84f4d6f1", "content-length": "372", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
86692025-01-25T00:23:18.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86702025-01-25T00:23:18.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86712025-01-25T00:23:18.880ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86722025-01-25T00:23:18.881ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef13427b-1daa-4a2f-8eef-993509254ef7", "content-length": "691", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
86732025-01-25T00:23:18.881ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
86742025-01-25T00:23:18.881ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
86752025-01-25T00:23:18.881ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
86762025-01-25T00:23:18.884ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 459.668484ms iteration = 28 status = {}
86772025-01-25T00:23:18.895ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
86782025-01-25T00:23:18.895ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86792025-01-25T00:23:18.896ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "65dc0805-9eea-4b91-b6ec-20f34ed96ac9", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
86802025-01-25T00:23:18.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86812025-01-25T00:23:18.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86822025-01-25T00:23:18.897ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
86832025-01-25T00:23:18.897ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b66083d7-fb74-415b-9f25-864e554340ce", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
86842025-01-25T00:23:18.897ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
86852025-01-25T00:23:18.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86862025-01-25T00:23:18.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86872025-01-25T00:23:18.899ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "95c8a136-4c0d-4da1-a5dd-5a4e96e23519", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
86882025-01-25T00:23:18.900ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
86892025-01-25T00:23:18.902ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b84ca294-044b-440f-9679-026a9e7b1041", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
86902025-01-25T00:23:18.902ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
86912025-01-25T00:23:18.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86922025-01-25T00:23:18.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86932025-01-25T00:23:18.904ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
86942025-01-25T00:23:18.904ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 480.057709ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
86952025-01-25T00:23:18.907ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
86962025-01-25T00:23:18.907ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86972025-01-25T00:23:18.907ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0e937165-caf7-4c05-94ac-6c01bd03b45b", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
86982025-01-25T00:23:18.909ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 484.567803ms iteration = 28 status = {}
86992025-01-25T00:23:18.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87002025-01-25T00:23:18.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87012025-01-25T00:23:18.957ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
87022025-01-25T00:23:18.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87032025-01-25T00:23:18.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87042025-01-25T00:23:18.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87052025-01-25T00:23:18.968ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b988435-3839-4dcd-8b5d-986fde1f7ee9", "content-length": "134", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
87062025-01-25T00:23:18.968ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87072025-01-25T00:23:18.968ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
87082025-01-25T00:23:18.968ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
87092025-01-25T00:23:18.968ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87102025-01-25T00:23:18.968ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87112025-01-25T00:23:18.968ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87122025-01-25T00:23:18.968ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87132025-01-25T00:23:18.968ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87142025-01-25T00:23:18.968ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87152025-01-25T00:23:18.968ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87162025-01-25T00:23:18.968ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
87172025-01-25T00:23:18.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87182025-01-25T00:23:18.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87192025-01-25T00:23:18.971ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87202025-01-25T00:23:18.971ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e084f731-6552-4054-820f-d12a8495d2de", "content-length": "2", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
87212025-01-25T00:23:18.971ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87222025-01-25T00:23:18.971ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3517bb8-faaf-481c-b946-cdbc1938debc", "content-length": "52", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
87232025-01-25T00:23:18.971ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
87242025-01-25T00:23:18.971ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87252025-01-25T00:23:19.071ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "48e5ac8b-1b22-4762-95ce-5a1f22db1cbe", "date": "Sat, 25 Jan 2025 00:23:18 GMT"} })
87262025-01-25T00:23:19.071ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
87272025-01-25T00:23:19.071ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87282025-01-25T00:23:19.075ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fc15158-5792-4d6c-b1a5-0cb902b5df21", "content-length": "682", "date": "Sat, 25 Jan 2025 00:23:19 GMT"} })
87292025-01-25T00:23:19.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87302025-01-25T00:23:19.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87312025-01-25T00:23:19.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87322025-01-25T00:23:19.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87332025-01-25T00:23:19.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87342025-01-25T00:23:19.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87352025-01-25T00:23:19.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87362025-01-25T00:23:19.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87372025-01-25T00:23:19.094ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 669.844188ms iteration = 27 status = {}
87382025-01-25T00:23:19.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3a281042-d3de-4f8d-81ee-5af1b59de6bf roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87392025-01-25T00:23:19.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3a281042-d3de-4f8d-81ee-5af1b59de6bf resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87402025-01-25T00:23:19.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 3a281042-d3de-4f8d-81ee-5af1b59de6bf response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87412025-01-25T00:23:20.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 89ee0e07-447f-44d4-9939-3adaa817c6e4 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87422025-01-25T00:23:20.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 89ee0e07-447f-44d4-9939-3adaa817c6e4 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87432025-01-25T00:23:20.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 89ee0e07-447f-44d4-9939-3adaa817c6e4 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87442025-01-25T00:23:20.988ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 548 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = bf0d488e-6bc4-44f4-9488-dd1e9eafce01 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
87452025-01-25T00:23:21.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 31604c34-b343-4507-9e1b-0f7b1a60ef6e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87462025-01-25T00:23:21.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 31604c34-b343-4507-9e1b-0f7b1a60ef6e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87472025-01-25T00:23:21.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 31604c34-b343-4507-9e1b-0f7b1a60ef6e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87482025-01-25T00:23:22.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f7833f10-1d31-4dc2-8a9f-90e19c98e571 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87492025-01-25T00:23:22.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f7833f10-1d31-4dc2-8a9f-90e19c98e571 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87502025-01-25T00:23:22.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f7833f10-1d31-4dc2-8a9f-90e19c98e571 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87512025-01-25T00:23:23.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cd545984-9638-459c-b574-3ab4f72d55e6 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87522025-01-25T00:23:23.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cd545984-9638-459c-b574-3ab4f72d55e6 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87532025-01-25T00:23:23.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = cd545984-9638-459c-b574-3ab4f72d55e6 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87542025-01-25T00:23:24.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1dc8b6a8-b85f-4f08-bed8-471a6529476b roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87552025-01-25T00:23:24.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1dc8b6a8-b85f-4f08-bed8-471a6529476b resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87562025-01-25T00:23:24.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 1dc8b6a8-b85f-4f08-bed8-471a6529476b response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87572025-01-25T00:23:25.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8fbb16b7-4fbf-4da3-8cad-19eb297641bb roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87582025-01-25T00:23:25.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8fbb16b7-4fbf-4da3-8cad-19eb297641bb resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87592025-01-25T00:23:25.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8fbb16b7-4fbf-4da3-8cad-19eb297641bb response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87602025-01-25T00:23:25.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 98c111c4-b07d-41b8-9304-11b0235d994a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
87612025-01-25T00:23:25.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 98c111c4-b07d-41b8-9304-11b0235d994a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
87622025-01-25T00:23:25.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:52436 req_id = 98c111c4-b07d-41b8-9304-11b0235d994a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
87632025-01-25T00:23:26.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d8349914-8602-4a0d-a6ad-ee80e80e0567 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87642025-01-25T00:23:26.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d8349914-8602-4a0d-a6ad-ee80e80e0567 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87652025-01-25T00:23:26.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = d8349914-8602-4a0d-a6ad-ee80e80e0567 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87662025-01-25T00:23:27.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2d9bea34-135e-4ba7-9ac6-741b23a9437e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87672025-01-25T00:23:27.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2d9bea34-135e-4ba7-9ac6-741b23a9437e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87682025-01-25T00:23:27.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 2d9bea34-135e-4ba7-9ac6-741b23a9437e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87692025-01-25T00:23:28.424ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
87702025-01-25T00:23:28.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87712025-01-25T00:23:28.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87722025-01-25T00:23:28.425ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
87732025-01-25T00:23:28.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87742025-01-25T00:23:28.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87752025-01-25T00:23:28.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87762025-01-25T00:23:28.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87772025-01-25T00:23:28.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87782025-01-25T00:23:28.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87792025-01-25T00:23:28.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87802025-01-25T00:23:28.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87812025-01-25T00:23:28.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.828815ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87822025-01-25T00:23:28.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87832025-01-25T00:23:28.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87842025-01-25T00:23:28.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87852025-01-25T00:23:28.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
87862025-01-25T00:23:28.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87872025-01-25T00:23:28.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87882025-01-25T00:23:28.448ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
87892025-01-25T00:23:28.448ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.651143ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
87902025-01-25T00:23:28.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fa0e537c-b415-4b7d-9a8f-00beeada9ace roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87912025-01-25T00:23:28.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fa0e537c-b415-4b7d-9a8f-00beeada9ace resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87922025-01-25T00:23:28.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = fa0e537c-b415-4b7d-9a8f-00beeada9ace response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87932025-01-25T00:23:29.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b0a23104-7fc7-4c47-8ff1-dffa9e978004 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87942025-01-25T00:23:29.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b0a23104-7fc7-4c47-8ff1-dffa9e978004 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87952025-01-25T00:23:29.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b0a23104-7fc7-4c47-8ff1-dffa9e978004 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87962025-01-25T00:23:30.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 14673e58-6816-4311-a363-f2e4d093e594 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87972025-01-25T00:23:30.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 14673e58-6816-4311-a363-f2e4d093e594 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87982025-01-25T00:23:30.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 14673e58-6816-4311-a363-f2e4d093e594 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
87992025-01-25T00:23:30.988ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 636 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = b731827a-96c5-4e62-adcf-be273daf3584 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
88002025-01-25T00:23:31.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5e6e3e1a-3f54-44e0-bfcf-aa51df201586 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88012025-01-25T00:23:31.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5e6e3e1a-3f54-44e0-bfcf-aa51df201586 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88022025-01-25T00:23:31.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5e6e3e1a-3f54-44e0-bfcf-aa51df201586 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88032025-01-25T00:23:32.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a1d332f1-1fe8-4325-9702-26d3c3e4a11c roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88042025-01-25T00:23:32.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a1d332f1-1fe8-4325-9702-26d3c3e4a11c resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88052025-01-25T00:23:32.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = a1d332f1-1fe8-4325-9702-26d3c3e4a11c response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88062025-01-25T00:23:33.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b48e1346-133c-4957-9d6f-68857704f481 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88072025-01-25T00:23:33.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b48e1346-133c-4957-9d6f-68857704f481 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88082025-01-25T00:23:33.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b48e1346-133c-4957-9d6f-68857704f481 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88092025-01-25T00:23:34.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 807c4430-4cd4-43a4-9720-480951d676fc roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88102025-01-25T00:23:34.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 807c4430-4cd4-43a4-9720-480951d676fc resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88112025-01-25T00:23:34.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 807c4430-4cd4-43a4-9720-480951d676fc response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88122025-01-25T00:23:35.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 43502d4e-c81e-4b1f-8d8e-a5c1cec34184 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88132025-01-25T00:23:35.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 43502d4e-c81e-4b1f-8d8e-a5c1cec34184 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88142025-01-25T00:23:35.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 43502d4e-c81e-4b1f-8d8e-a5c1cec34184 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88152025-01-25T00:23:36.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b6a6d352-ab28-4388-a8a3-595f36bc0730 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88162025-01-25T00:23:36.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b6a6d352-ab28-4388-a8a3-595f36bc0730 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88172025-01-25T00:23:36.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b6a6d352-ab28-4388-a8a3-595f36bc0730 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88182025-01-25T00:23:37.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a7de65f-6ebb-4d22-8254-5347b8d4690e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88192025-01-25T00:23:37.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a7de65f-6ebb-4d22-8254-5347b8d4690e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88202025-01-25T00:23:37.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 7a7de65f-6ebb-4d22-8254-5347b8d4690e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88212025-01-25T00:23:38.424ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
88222025-01-25T00:23:38.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88232025-01-25T00:23:38.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88242025-01-25T00:23:38.425ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
88252025-01-25T00:23:38.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88262025-01-25T00:23:38.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88272025-01-25T00:23:38.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88282025-01-25T00:23:38.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88292025-01-25T00:23:38.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88302025-01-25T00:23:38.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88312025-01-25T00:23:38.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88322025-01-25T00:23:38.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88332025-01-25T00:23:38.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88342025-01-25T00:23:38.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88352025-01-25T00:23:38.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88362025-01-25T00:23:38.435ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
88372025-01-25T00:23:38.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88382025-01-25T00:23:38.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88392025-01-25T00:23:38.451ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
88402025-01-25T00:23:38.451ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.02341ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
88412025-01-25T00:23:38.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.760885ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88422025-01-25T00:23:38.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 46c33fb3-0390-4b7e-9237-82088186b04f roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88432025-01-25T00:23:38.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 46c33fb3-0390-4b7e-9237-82088186b04f resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88442025-01-25T00:23:38.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 46c33fb3-0390-4b7e-9237-82088186b04f response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88452025-01-25T00:23:39.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 88a8de15-0d14-4e95-8d33-924b19176afa roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88462025-01-25T00:23:39.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 88a8de15-0d14-4e95-8d33-924b19176afa resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88472025-01-25T00:23:39.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 88a8de15-0d14-4e95-8d33-924b19176afa response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88482025-01-25T00:23:40.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ceef28bd-2dfa-4fa3-9c01-364fc49000e9 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88492025-01-25T00:23:40.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ceef28bd-2dfa-4fa3-9c01-364fc49000e9 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88502025-01-25T00:23:40.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2751 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = ceef28bd-2dfa-4fa3-9c01-364fc49000e9 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88512025-01-25T00:23:40.989ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 920 local_addr = [fd00:1122:3344:101::b]:60024 method = GET remote_addr = [fd00:1122:3344:101::d]:57666 req_id = 974b9b55-8240-473b-ad3f-53e3b7e46df9 response_code = 200 uri = /af353237-4651-4023-8604-ee309f64048e
88522025-01-25T00:23:41.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 72ba8f37-454d-4920-8010-ce27fedc0262 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88532025-01-25T00:23:41.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 72ba8f37-454d-4920-8010-ce27fedc0262 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88542025-01-25T00:23:41.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 72ba8f37-454d-4920-8010-ce27fedc0262 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88552025-01-25T00:23:42.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8b257d4b-2504-4474-8a91-413ceb3a5466 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88562025-01-25T00:23:42.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8b257d4b-2504-4474-8a91-413ceb3a5466 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88572025-01-25T00:23:42.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 8b257d4b-2504-4474-8a91-413ceb3a5466 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88582025-01-25T00:23:43.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f4d6c8f3-1cca-4542-9349-d87cc60ba65e roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88592025-01-25T00:23:43.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f4d6c8f3-1cca-4542-9349-d87cc60ba65e resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88602025-01-25T00:23:43.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = f4d6c8f3-1cca-4542-9349-d87cc60ba65e response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88612025-01-25T00:23:44.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5dd61b55-34cf-43aa-8567-6fa2c6212f48 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88622025-01-25T00:23:44.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5dd61b55-34cf-43aa-8567-6fa2c6212f48 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88632025-01-25T00:23:44.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 5dd61b55-34cf-43aa-8567-6fa2c6212f48 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88642025-01-25T00:23:45.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 19f74c5d-4fe4-498c-b594-252a375f7b8a roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88652025-01-25T00:23:45.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 19f74c5d-4fe4-498c-b594-252a375f7b8a resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88662025-01-25T00:23:45.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 19f74c5d-4fe4-498c-b594-252a375f7b8a response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88672025-01-25T00:23:46.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 32f8ea28-b3d7-4af1-9775-7ebcbb9326ac roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88682025-01-25T00:23:46.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 32f8ea28-b3d7-4af1-9775-7ebcbb9326ac resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88692025-01-25T00:23:46.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = 32f8ea28-b3d7-4af1-9775-7ebcbb9326ac response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88702025-01-25T00:23:47.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b7ec06b2-680b-431d-b440-2c1c9618a389 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88712025-01-25T00:23:47.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b7ec06b2-680b-431d-b440-2c1c9618a389 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88722025-01-25T00:23:47.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b7ec06b2-680b-431d-b440-2c1c9618a389 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
88732025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
88742025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
88752025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88762025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
88772025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88782025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88792025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
88802025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
88812025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88822025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88832025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
88842025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88852025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
88862025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
88872025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88882025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
88892025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88902025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
88912025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88922025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88932025-01-25T00:23:48.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88942025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88952025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88962025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88972025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88982025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88992025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89002025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89012025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
89022025-01-25T00:23:48.425ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89032025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
89042025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89052025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89062025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
89072025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
89082025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
89092025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89102025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
89112025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89122025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
89132025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89142025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89152025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
89162025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
89172025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89182025-01-25T00:23:48.425ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89192025-01-25T00:23:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89202025-01-25T00:23:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89212025-01-25T00:23:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89222025-01-25T00:23:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89232025-01-25T00:23:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89242025-01-25T00:23:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89252025-01-25T00:23:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89262025-01-25T00:23:48.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89272025-01-25T00:23:48.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89282025-01-25T00:23:48.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89292025-01-25T00:23:48.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89302025-01-25T00:23:48.429ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.676464ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89312025-01-25T00:23:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89322025-01-25T00:23:48.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89332025-01-25T00:23:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89342025-01-25T00:23:48.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89352025-01-25T00:23:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89362025-01-25T00:23:48.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89372025-01-25T00:23:48.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89382025-01-25T00:23:48.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89392025-01-25T00:23:48.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89402025-01-25T00:23:48.432ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 148006106 } })
89412025-01-25T00:23:48.433ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139
89422025-01-25T00:23:48.434ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 149641275 } })
89432025-01-25T00:23:48.434ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1139
89442025-01-25T00:23:48.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89452025-01-25T00:23:48.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89462025-01-25T00:23:48.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89472025-01-25T00:23:48.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89482025-01-25T00:23:48.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89492025-01-25T00:23:48.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89502025-01-25T00:23:48.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89512025-01-25T00:23:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89522025-01-25T00:23:48.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89532025-01-25T00:23:48.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89542025-01-25T00:23:48.454ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-32998bfc-bda9-4f32-bfea-b5a21baa4aa2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 169190496 } })
89552025-01-25T00:23:48.454ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
89562025-01-25T00:23:48.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89572025-01-25T00:23:48.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89582025-01-25T00:23:48.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89592025-01-25T00:23:48.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 88a4c0e7-8892-49ca-9314-7397e41102a2, lookup_type: ById(88a4c0e7-8892-49ca-9314-7397e41102a2) } result = Ok(())
89602025-01-25T00:23:48.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89612025-01-25T00:23:48.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89622025-01-25T00:23:48.491ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 original_time_created = 2025-01-25 00:10:11.660165 UTC target_id = 88a4c0e7-8892-49ca-9314-7397e41102a2 time_created = 2025-01-25 00:10:11.660165 UTC
89632025-01-25T00:23:48.491ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.819508ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"88a4c0e7-8892-49ca-9314-7397e41102a2","time_created":"2025-01-25T00:10:11.660165Z"}
89642025-01-25T00:23:48.492ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89652025-01-25T00:23:48.494ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89662025-01-25T00:23:48.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
89672025-01-25T00:23:48.495ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89682025-01-25T00:23:48.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89692025-01-25T00:23:48.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89702025-01-25T00:23:48.496ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89712025-01-25T00:23:48.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89722025-01-25T00:23:48.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89732025-01-25T00:23:48.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89742025-01-25T00:23:48.499ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89752025-01-25T00:23:48.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89762025-01-25T00:23:48.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89772025-01-25T00:23:48.501ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89782025-01-25T00:23:48.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89792025-01-25T00:23:48.502ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89802025-01-25T00:23:48.502ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89812025-01-25T00:23:48.502ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89822025-01-25T00:23:48.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.81148ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
89832025-01-25T00:23:48.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89842025-01-25T00:23:48.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89852025-01-25T00:23:48.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89862025-01-25T00:23:48.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89872025-01-25T00:23:48.503ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89882025-01-25T00:23:48.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89892025-01-25T00:23:48.507ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89902025-01-25T00:23:48.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89912025-01-25T00:23:48.509ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89922025-01-25T00:23:48.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89932025-01-25T00:23:48.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89942025-01-25T00:23:48.511ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89952025-01-25T00:23:48.511ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.132088ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89962025-01-25T00:23:48.515ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89972025-01-25T00:23:48.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 32998bfc-bda9-4f32-bfea-b5a21baa4aa2, lookup_type: ById(32998bfc-bda9-4f32-bfea-b5a21baa4aa2) } result = Ok(())
89982025-01-25T00:23:48.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89992025-01-25T00:23:48.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90002025-01-25T00:23:48.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90012025-01-25T00:23:48.518ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 92.410191ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
90022025-01-25T00:23:48.518ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 94.276521ms iteration = 28 status = 0
90032025-01-25T00:23:48.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90042025-01-25T00:23:48.524ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90052025-01-25T00:23:48.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90062025-01-25T00:23:48.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90072025-01-25T00:23:48.527ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
90082025-01-25T00:23:48.527ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90092025-01-25T00:23:48.527ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4b71e1d-8e5e-4865-98c8-297257ffb577", "content-length": "26", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
90102025-01-25T00:23:48.527ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90112025-01-25T00:23:48.529ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90122025-01-25T00:23:48.551ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1147 zone_address = fd00:1122:3344:101::2
90132025-01-25T00:23:48.551ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90142025-01-25T00:23:48.553ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "449ec239-2320-4800-9c1d-72635461ac3a", "content-length": "26", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
90152025-01-25T00:23:48.553ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1152 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90162025-01-25T00:23:48.553ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90172025-01-25T00:23:48.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90182025-01-25T00:23:48.555ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90192025-01-25T00:23:48.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 135.257344ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90202025-01-25T00:23:48.564ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90212025-01-25T00:23:48.564ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90222025-01-25T00:23:48.564ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90232025-01-25T00:23:48.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90242025-01-25T00:23:48.570ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90252025-01-25T00:23:48.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90262025-01-25T00:23:48.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 146.688664ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90272025-01-25T00:23:48.571ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 145.76663ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90282025-01-25T00:23:48.590ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1147 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b zone_address = fd00:1122:3344:101::2
90292025-01-25T00:23:48.590ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90302025-01-25T00:23:48.591ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "022be30a-92d6-421c-ad94-b4b20432958e", "content-length": "26", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
90312025-01-25T00:23:48.591ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1152 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90322025-01-25T00:23:48.592ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90332025-01-25T00:23:48.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90342025-01-25T00:23:48.593ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1184 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
90352025-01-25T00:23:48.629ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 204.717856ms iteration = 31 status = {"physical_disks_added":0}
90362025-01-25T00:23:48.644ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90372025-01-25T00:23:48.646ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90382025-01-25T00:23:48.646ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1b02e73-6f01-4ff8-b13d-b9e9b4e2c648", "content-length": "372", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
90392025-01-25T00:23:48.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90402025-01-25T00:23:48.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90412025-01-25T00:23:48.646ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90422025-01-25T00:23:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
90432025-01-25T00:23:48.648ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90442025-01-25T00:23:48.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90452025-01-25T00:23:48.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90462025-01-25T00:23:48.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90472025-01-25T00:23:48.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90482025-01-25T00:23:48.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90492025-01-25T00:23:48.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90502025-01-25T00:23:48.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90512025-01-25T00:23:48.682ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:357
90522025-01-25T00:23:48.682ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 257.850253ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
90532025-01-25T00:23:48.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 258.813618ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
90542025-01-25T00:23:48.688ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90552025-01-25T00:23:48.688ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90562025-01-25T00:23:48.688ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 262.853678ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90572025-01-25T00:23:48.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90582025-01-25T00:23:48.696ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90592025-01-25T00:23:48.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90602025-01-25T00:23:48.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90612025-01-25T00:23:48.699ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
90622025-01-25T00:23:48.699ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90632025-01-25T00:23:48.699ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "21fcc46d-3c1c-4094-af19-b412ca0dccd0", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
90642025-01-25T00:23:48.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90652025-01-25T00:23:48.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90662025-01-25T00:23:48.751ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 326.723041ms iteration = 28 status = {}
90672025-01-25T00:23:48.767ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90682025-01-25T00:23:48.767ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7657325-af46-4239-97bf-ac0ca1e6f16e", "content-length": "2", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
90692025-01-25T00:23:48.769ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90702025-01-25T00:23:48.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90712025-01-25T00:23:48.790ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90722025-01-25T00:23:48.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90732025-01-25T00:23:48.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90742025-01-25T00:23:48.792ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 368.224208ms iteration = 28 status = null
90752025-01-25T00:23:48.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90762025-01-25T00:23:48.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90772025-01-25T00:23:48.798ZINFOnexus (BackgroundTasks): VPC route manager sled 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90782025-01-25T00:23:48.798ZDEBGnexus (BackgroundTasks): client request SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90792025-01-25T00:23:48.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90802025-01-25T00:23:48.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90812025-01-25T00:23:48.826ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 5b5b857d-153c-405a-a269-afbddd539673, rack_id: 9df81f60-f00c-4bd4-967d-ea4e78d21a1b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(087bc104-706d-4b3f-a1b0-01c0f267c1c1) } rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
90822025-01-25T00:23:48.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90832025-01-25T00:23:48.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90842025-01-25T00:23:48.827ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "264acc8b-1c2c-472b-9eea-3c2adb7c31b0", "content-length": "691", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
90852025-01-25T00:23:48.827ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90862025-01-25T00:23:48.827ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90872025-01-25T00:23:48.827ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90882025-01-25T00:23:48.828ZDEBGnexus (BackgroundTasks): client response SledAgent = 32998bfc-bda9-4f32-bfea-b5a21baa4aa2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f29dc0f2-dedb-4d0d-ad95-4df6c4c0bbb6", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
90892025-01-25T00:23:48.829ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 403.931673ms iteration = 29 status = {}
90902025-01-25T00:23:48.830ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 406.146654ms iteration = 29 status = {}
90912025-01-25T00:23:48.839ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90922025-01-25T00:23:48.839ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "be0b3482-3360-45ef-9bca-e11e47a8b350", "content-length": "134", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
90932025-01-25T00:23:48.839ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90942025-01-25T00:23:48.839ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 087bc104-706d-4b3f-a1b0-01c0f267c1c1
90952025-01-25T00:23:48.840ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90962025-01-25T00:23:48.840ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90972025-01-25T00:23:48.840ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90982025-01-25T00:23:48.840ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90992025-01-25T00:23:48.840ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91002025-01-25T00:23:48.840ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91012025-01-25T00:23:48.840ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91022025-01-25T00:23:48.840ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91032025-01-25T00:23:48.840ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b
91042025-01-25T00:23:48.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91052025-01-25T00:23:48.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91062025-01-25T00:23:48.843ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91072025-01-25T00:23:48.843ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2729c9db-6fcb-4dd3-b42a-da42f6d0142d", "content-length": "2", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
91082025-01-25T00:23:48.843ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91092025-01-25T00:23:48.843ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b344888-af01-4724-b5fb-dbe8841a2bc3", "content-length": "52", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
91102025-01-25T00:23:48.843ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch_location = Switch0
91112025-01-25T00:23:48.843ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91122025-01-25T00:23:48.965ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a504f2d6-a605-4fea-8a2c-18e409fbbaf9", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
91132025-01-25T00:23:48.965ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b switch = Switch0
91142025-01-25T00:23:48.965ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91152025-01-25T00:23:48.965ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9df81f60-f00c-4bd4-967d-ea4e78d21a1b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8f3ccc0-89bc-47d6-9a9c-b8d495476029", "content-length": "682", "date": "Sat, 25 Jan 2025 00:23:48 GMT"} })
91162025-01-25T00:23:48.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91172025-01-25T00:23:48.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91182025-01-25T00:23:48.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91192025-01-25T00:23:48.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91202025-01-25T00:23:48.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91212025-01-25T00:23:48.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91222025-01-25T00:23:48.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b88042cf-e037-4296-97e6-70be4db918d9 roles = RoleSet { roles: {} } uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
91232025-01-25T00:23:48.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b88042cf-e037-4296-97e6-70be4db918d9 resource = Database result = Ok(()) uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
91242025-01-25T00:23:48.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91252025-01-25T00:23:48.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91262025-01-25T00:23:48.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62612 req_id = b88042cf-e037-4296-97e6-70be4db918d9 response_code = 200 uri = /probes/32998bfc-bda9-4f32-bfea-b5a21baa4aa2
91272025-01-25T00:23:48.983ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 558.613029ms iteration = 28 status = {}