Max level shown:
12024-12-06T20:45:00.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7f5fc1e6-de28-4418-9b48-f339a03103a5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22024-12-06T20:45:00.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7f5fc1e6-de28-4418-9b48-f339a03103a5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32024-12-06T20:45:00.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7f5fc1e6-de28-4418-9b48-f339a03103a5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42024-12-06T20:45:01.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4824941a-2514-4862-82b2-5cdbc858fd6a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52024-12-06T20:45:01.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4824941a-2514-4862-82b2-5cdbc858fd6a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
62024-12-06T20:45:01.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4824941a-2514-4862-82b2-5cdbc858fd6a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
72024-12-06T20:45:02.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f07c5ba8-2429-427e-9bc5-9ce95d4a0184 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
82024-12-06T20:45:02.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f07c5ba8-2429-427e-9bc5-9ce95d4a0184 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
92024-12-06T20:45:02.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f07c5ba8-2429-427e-9bc5-9ce95d4a0184 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
102024-12-06T20:45:04.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a878fdbf-7bb3-4e2a-be91-e6bff4ccc8ef roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
112024-12-06T20:45:04.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a878fdbf-7bb3-4e2a-be91-e6bff4ccc8ef resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
122024-12-06T20:45:04.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a878fdbf-7bb3-4e2a-be91-e6bff4ccc8ef response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
132024-12-06T20:45:05.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e7f21b94-3da9-4ed8-a428-c0fc4ec18c37 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
142024-12-06T20:45:05.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e7f21b94-3da9-4ed8-a428-c0fc4ec18c37 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
152024-12-06T20:45:05.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e7f21b94-3da9-4ed8-a428-c0fc4ec18c37 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
162024-12-06T20:45:06.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7c609ea9-1cb2-4423-9a96-366097fc519e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
172024-12-06T20:45:06.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7c609ea9-1cb2-4423-9a96-366097fc519e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
182024-12-06T20:45:06.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7c609ea9-1cb2-4423-9a96-366097fc519e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
192024-12-06T20:45:07.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b6128a7b-0bcb-43ae-8c3e-29f0d9372c41 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
202024-12-06T20:45:07.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b6128a7b-0bcb-43ae-8c3e-29f0d9372c41 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
212024-12-06T20:45:07.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b6128a7b-0bcb-43ae-8c3e-29f0d9372c41 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
222024-12-06T20:45:08.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8cfcfe34-30d6-42d8-ad14-cd29497b1df2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
232024-12-06T20:45:08.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8cfcfe34-30d6-42d8-ad14-cd29497b1df2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
242024-12-06T20:45:08.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8cfcfe34-30d6-42d8-ad14-cd29497b1df2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
252024-12-06T20:45:08.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
262024-12-06T20:45:08.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
272024-12-06T20:45:08.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
282024-12-06T20:45:08.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
292024-12-06T20:45:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
302024-12-06T20:45:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
312024-12-06T20:45:08.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
322024-12-06T20:45:08.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
332024-12-06T20:45:08.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
342024-12-06T20:45:08.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
352024-12-06T20:45:08.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
362024-12-06T20:45:08.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
372024-12-06T20:45:08.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
382024-12-06T20:45:08.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
392024-12-06T20:45:08.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
402024-12-06T20:45:08.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
412024-12-06T20:45:08.892ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
422024-12-06T20:45:08.892ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.318007ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
432024-12-06T20:45:08.893ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
442024-12-06T20:45:08.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
452024-12-06T20:45:08.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.145069ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
462024-12-06T20:45:09.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 37aa5486-5796-400a-95a9-b3027c1f5000 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
472024-12-06T20:45:09.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 37aa5486-5796-400a-95a9-b3027c1f5000 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
482024-12-06T20:45:09.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 37aa5486-5796-400a-95a9-b3027c1f5000 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
492024-12-06T20:45:10.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 58595f03-7eaa-4e95-a2b2-50189c47ddac roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
502024-12-06T20:45:10.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 58595f03-7eaa-4e95-a2b2-50189c47ddac resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
512024-12-06T20:45:10.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 58595f03-7eaa-4e95-a2b2-50189c47ddac response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
522024-12-06T20:45:11.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6629b952-e780-436d-993f-a42d8e6410a0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
532024-12-06T20:45:11.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6629b952-e780-436d-993f-a42d8e6410a0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
542024-12-06T20:45:11.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6629b952-e780-436d-993f-a42d8e6410a0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
552024-12-06T20:45:12.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4073c9d3-384c-4fc6-8ffb-a905cabd8a8f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
562024-12-06T20:45:12.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4073c9d3-384c-4fc6-8ffb-a905cabd8a8f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
572024-12-06T20:45:12.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4073c9d3-384c-4fc6-8ffb-a905cabd8a8f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
582024-12-06T20:45:13.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 642a8c93-d16b-4a02-9f90-5b851d8c0846 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
592024-12-06T20:45:13.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 642a8c93-d16b-4a02-9f90-5b851d8c0846 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
602024-12-06T20:45:13.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 642a8c93-d16b-4a02-9f90-5b851d8c0846 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
612024-12-06T20:45:14.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 47972012-3a73-4b55-8ea7-2e70ec2ae9c1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
622024-12-06T20:45:14.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 47972012-3a73-4b55-8ea7-2e70ec2ae9c1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
632024-12-06T20:45:14.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 47972012-3a73-4b55-8ea7-2e70ec2ae9c1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
642024-12-06T20:45:15.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 185a1215-d98b-48bd-b2a2-10bfac8c79aa roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
652024-12-06T20:45:15.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 185a1215-d98b-48bd-b2a2-10bfac8c79aa resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
662024-12-06T20:45:15.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 185a1215-d98b-48bd-b2a2-10bfac8c79aa response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
672024-12-06T20:45:16.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9f29ed85-2b9b-4989-891c-ff94544e1a91 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
682024-12-06T20:45:16.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9f29ed85-2b9b-4989-891c-ff94544e1a91 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
692024-12-06T20:45:16.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9f29ed85-2b9b-4989-891c-ff94544e1a91 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
702024-12-06T20:45:17.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d71f541c-678e-43bb-8bb2-e651285abff7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
712024-12-06T20:45:17.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d71f541c-678e-43bb-8bb2-e651285abff7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
722024-12-06T20:45:17.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d71f541c-678e-43bb-8bb2-e651285abff7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
732024-12-06T20:45:18.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4466f414-ec00-4908-a4e0-aa12a99996a0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
742024-12-06T20:45:18.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4466f414-ec00-4908-a4e0-aa12a99996a0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
752024-12-06T20:45:18.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4466f414-ec00-4908-a4e0-aa12a99996a0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
762024-12-06T20:45:18.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
772024-12-06T20:45:18.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
782024-12-06T20:45:18.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
792024-12-06T20:45:18.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
802024-12-06T20:45:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
812024-12-06T20:45:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
822024-12-06T20:45:18.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
832024-12-06T20:45:18.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
842024-12-06T20:45:18.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
852024-12-06T20:45:18.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
862024-12-06T20:45:18.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
872024-12-06T20:45:18.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
882024-12-06T20:45:18.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
892024-12-06T20:45:18.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
902024-12-06T20:45:18.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
912024-12-06T20:45:18.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
922024-12-06T20:45:18.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
932024-12-06T20:45:18.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
942024-12-06T20:45:18.882ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
952024-12-06T20:45:18.882ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.108603ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
962024-12-06T20:45:18.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.881982ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
972024-12-06T20:45:19.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad51d778-44c7-41d9-8503-d650beab0e44 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
982024-12-06T20:45:19.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad51d778-44c7-41d9-8503-d650beab0e44 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
992024-12-06T20:45:19.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad51d778-44c7-41d9-8503-d650beab0e44 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1002024-12-06T20:45:20.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3f2267f1-d0e6-4b10-a6aa-3934b06560bf roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1012024-12-06T20:45:20.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3f2267f1-d0e6-4b10-a6aa-3934b06560bf resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1022024-12-06T20:45:20.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3f2267f1-d0e6-4b10-a6aa-3934b06560bf response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1032024-12-06T20:45:21.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cec27575-a11b-4e8e-bda1-f8487fcbefc4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1042024-12-06T20:45:21.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cec27575-a11b-4e8e-bda1-f8487fcbefc4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1052024-12-06T20:45:21.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cec27575-a11b-4e8e-bda1-f8487fcbefc4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1062024-12-06T20:45:22.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b2621ffe-8ad1-4293-b597-296af051ae64 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1072024-12-06T20:45:22.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b2621ffe-8ad1-4293-b597-296af051ae64 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1082024-12-06T20:45:22.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b2621ffe-8ad1-4293-b597-296af051ae64 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1092024-12-06T20:45:23.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 157fcc0c-f33c-4e55-9eee-2c18dd8a8c3c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1102024-12-06T20:45:23.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 157fcc0c-f33c-4e55-9eee-2c18dd8a8c3c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1112024-12-06T20:45:23.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 157fcc0c-f33c-4e55-9eee-2c18dd8a8c3c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1122024-12-06T20:45:24.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fe4cef4d-1d48-424e-9eb9-098f8b88bf21 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1132024-12-06T20:45:24.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fe4cef4d-1d48-424e-9eb9-098f8b88bf21 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1142024-12-06T20:45:24.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fe4cef4d-1d48-424e-9eb9-098f8b88bf21 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1152024-12-06T20:45:25.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d98ce1a9-6983-416b-a8af-33130878922b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1162024-12-06T20:45:25.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d98ce1a9-6983-416b-a8af-33130878922b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1172024-12-06T20:45:25.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d98ce1a9-6983-416b-a8af-33130878922b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1182024-12-06T20:45:26.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02adba9b-ba9c-4d0e-b0b2-0b6323ab5002 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1192024-12-06T20:45:26.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02adba9b-ba9c-4d0e-b0b2-0b6323ab5002 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1202024-12-06T20:45:26.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02adba9b-ba9c-4d0e-b0b2-0b6323ab5002 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1212024-12-06T20:45:27.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = e684ea6d-2dea-49bf-b1c1-bed9de51f7c7 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
1222024-12-06T20:45:27.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = e684ea6d-2dea-49bf-b1c1-bed9de51f7c7 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
1232024-12-06T20:45:27.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = e684ea6d-2dea-49bf-b1c1-bed9de51f7c7 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
1242024-12-06T20:45:27.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = f89dfa32-142d-4423-bfc2-b8c0c49b0bea roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIzOTY1ZTczOC0zMzA1LTRmY2QtOWRhMC00YzZlMGNlN2VkYzEifX0%3D
1252024-12-06T20:45:27.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = f89dfa32-142d-4423-bfc2-b8c0c49b0bea resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIzOTY1ZTczOC0zMzA1LTRmY2QtOWRhMC00YzZlMGNlN2VkYzEifX0%3D
1262024-12-06T20:45:27.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = f89dfa32-142d-4423-bfc2-b8c0c49b0bea response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIzOTY1ZTczOC0zMzA1LTRmY2QtOWRhMC00YzZlMGNlN2VkYzEifX0%3D
1272024-12-06T20:45:27.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ba26f47c-5b3f-4351-b7dc-5a2acbfb18fe roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1282024-12-06T20:45:27.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ba26f47c-5b3f-4351-b7dc-5a2acbfb18fe resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1292024-12-06T20:45:27.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ba26f47c-5b3f-4351-b7dc-5a2acbfb18fe response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1302024-12-06T20:45:28.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 995aa9c1-a484-4b87-89db-7e986a0a3c7a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1312024-12-06T20:45:28.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 995aa9c1-a484-4b87-89db-7e986a0a3c7a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1322024-12-06T20:45:28.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 995aa9c1-a484-4b87-89db-7e986a0a3c7a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
1332024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
1342024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1352024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
1362024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1372024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
1382024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1392024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1402024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
1412024-12-06T20:45:28.855ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
1422024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 14.661\u{b5}s iteration = 3 status = {"error":"no config"}
1432024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
1442024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
1452024-12-06T20:45:28.855ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
1462024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 15.17\u{b5}s iteration = 3 status = {"error":"no config"}
1472024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
1482024-12-06T20:45:28.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1492024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1502024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
1512024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
1522024-12-06T20:45:28.856ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:35:28.855895767 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1532024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1542024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
1552024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
1562024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
1572024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1582024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1592024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1602024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
1612024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
1622024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1632024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1642024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
1652024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1662024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1672024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
1682024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
1692024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
1702024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1712024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1722024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1732024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
1742024-12-06T20:45:28.856ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1752024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1762024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1772024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
1782024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
1792024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1802024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1812024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
1822024-12-06T20:45:28.856ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1832024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1842024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
1852024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1862024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1872024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
1882024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
1892024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1902024-12-06T20:45:28.856ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
1912024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
1922024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.831\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
1932024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1942024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1952024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
1962024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
1972024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1982024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
1992024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
2002024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
2012024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2022024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
2032024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2042024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2052024-12-06T20:45:28.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6259, tv_nsec: 193323228 } })
2062024-12-06T20:45:28.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6259, tv_nsec: 193376499 } })
2072024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2082024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
2092024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2102024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
2112024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2122024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2132024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2142024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2152024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2162024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2172024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2182024-12-06T20:45:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2192024-12-06T20:45:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2202024-12-06T20:45:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2212024-12-06T20:45:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2222024-12-06T20:45:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2232024-12-06T20:45:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2242024-12-06T20:45:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2252024-12-06T20:45:28.857ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
2262024-12-06T20:45:28.857ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.340384ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
2272024-12-06T20:45:28.857ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
2282024-12-06T20:45:28.857ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.451228ms iteration = 2 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
2292024-12-06T20:45:28.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2302024-12-06T20:45:28.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2312024-12-06T20:45:28.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322024-12-06T20:45:28.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2332024-12-06T20:45:28.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2342024-12-06T20:45:28.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2352024-12-06T20:45:28.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2362024-12-06T20:45:28.860ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:35:28.855895767 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2372024-12-06T20:45:28.860ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.969718ms iteration = 2 status = {"expiration":"2024-12-06T20:35:28.855895767Z","pruned":[]}
2382024-12-06T20:45:28.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2392024-12-06T20:45:28.861ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.385769ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2402024-12-06T20:45:28.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2412024-12-06T20:45:28.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2422024-12-06T20:45:28.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2432024-12-06T20:45:28.864ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6259, tv_nsec: 200863712 } })
2442024-12-06T20:45:28.864ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
2452024-12-06T20:45:28.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2462024-12-06T20:45:28.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2472024-12-06T20:45:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2482024-12-06T20:45:28.867ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2492024-12-06T20:45:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2502024-12-06T20:45:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2512024-12-06T20:45:28.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2522024-12-06T20:45:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2532024-12-06T20:45:28.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6259, tv_nsec: 204888826 } })
2542024-12-06T20:45:28.868ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
2552024-12-06T20:45:28.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2562024-12-06T20:45:28.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2572024-12-06T20:45:28.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2582024-12-06T20:45:28.871ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.285474ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
2592024-12-06T20:45:28.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2602024-12-06T20:45:28.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2612024-12-06T20:45:28.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2622024-12-06T20:45:28.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2632024-12-06T20:45:28.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.102164ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2642024-12-06T20:45:28.879ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2652024-12-06T20:45:28.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2662024-12-06T20:45:28.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2672024-12-06T20:45:28.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2682024-12-06T20:45:28.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2692024-12-06T20:45:28.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2702024-12-06T20:45:28.880ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2712024-12-06T20:45:28.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2722024-12-06T20:45:28.923ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2732024-12-06T20:45:28.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2742024-12-06T20:45:28.930ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2752024-12-06T20:45:28.930ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2762024-12-06T20:45:28.930ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.581183ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2772024-12-06T20:45:28.935ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2782024-12-06T20:45:28.935ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2792024-12-06T20:45:28.935ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2802024-12-06T20:45:28.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2812024-12-06T20:45:28.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2822024-12-06T20:45:28.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2832024-12-06T20:45:28.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2842024-12-06T20:45:28.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2852024-12-06T20:45:28.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2862024-12-06T20:45:28.939ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2872024-12-06T20:45:28.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2882024-12-06T20:45:28.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2892024-12-06T20:45:28.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2902024-12-06T20:45:28.940ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2912024-12-06T20:45:28.942ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 86.211723ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
2922024-12-06T20:45:28.943ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2932024-12-06T20:45:28.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2942024-12-06T20:45:28.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2952024-12-06T20:45:28.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2962024-12-06T20:45:28.943ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2972024-12-06T20:45:28.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2982024-12-06T20:45:28.943ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2992024-12-06T20:45:28.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3002024-12-06T20:45:28.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3012024-12-06T20:45:28.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3022024-12-06T20:45:28.944ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
3032024-12-06T20:45:28.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3042024-12-06T20:45:28.947ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3052024-12-06T20:45:28.947ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3062024-12-06T20:45:28.948ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a3bee19-b9e4-4f89-b8ce-903bc3f760b9", "content-length": "26", "date": "Fri, 06 Dec 2024 20:45:28 GMT"} })
3072024-12-06T20:45:28.948ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3082024-12-06T20:45:28.950ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3092024-12-06T20:45:28.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3102024-12-06T20:45:28.957ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6259, tv_nsec: 293722456 } })
3112024-12-06T20:45:28.957ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
3122024-12-06T20:45:28.957ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3132024-12-06T20:45:28.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3142024-12-06T20:45:28.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3152024-12-06T20:45:28.963ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3162024-12-06T20:45:28.963ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 107.176443ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3172024-12-06T20:45:28.965ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3182024-12-06T20:45:28.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3192024-12-06T20:45:28.968ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3202024-12-06T20:45:28.968ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3212024-12-06T20:45:28.968ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "784c3fa9-bb37-4f10-b76e-fcce87bd0b46", "content-length": "26", "date": "Fri, 06 Dec 2024 20:45:28 GMT"} })
3222024-12-06T20:45:28.968ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3232024-12-06T20:45:28.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3242024-12-06T20:45:28.989ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3252024-12-06T20:45:28.993ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3262024-12-06T20:45:28.996ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3272024-12-06T20:45:28.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3282024-12-06T20:45:28.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3292024-12-06T20:45:28.998ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3302024-12-06T20:45:28.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3312024-12-06T20:45:28.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
3322024-12-06T20:45:28.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3332024-12-06T20:45:28.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3342024-12-06T20:45:28.999ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3352024-12-06T20:45:28.999ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3362024-12-06T20:45:28.999ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3372024-12-06T20:45:28.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3382024-12-06T20:45:28.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3392024-12-06T20:45:29.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3402024-12-06T20:45:29.004ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3412024-12-06T20:45:29.004ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3422024-12-06T20:45:29.004ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3432024-12-06T20:45:29.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3442024-12-06T20:45:29.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3452024-12-06T20:45:29.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3462024-12-06T20:45:29.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3472024-12-06T20:45:29.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3482024-12-06T20:45:29.009ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3492024-12-06T20:45:29.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3502024-12-06T20:45:29.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3512024-12-06T20:45:29.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3522024-12-06T20:45:29.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3532024-12-06T20:45:29.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3542024-12-06T20:45:29.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3552024-12-06T20:45:29.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 160.21102ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3562024-12-06T20:45:29.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 160.286933ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
3572024-12-06T20:45:29.018ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
3582024-12-06T20:45:29.019ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 162.880539ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
3592024-12-06T20:45:29.020ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3602024-12-06T20:45:29.020ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3612024-12-06T20:45:29.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3622024-12-06T20:45:29.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3632024-12-06T20:45:29.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
3642024-12-06T20:45:29.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3652024-12-06T20:45:29.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3662024-12-06T20:45:29.021ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3672024-12-06T20:45:29.021ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3682024-12-06T20:45:29.021ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 165.427525ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3692024-12-06T20:45:29.022ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 165.841096ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3702024-12-06T20:45:29.023ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 166.870042ms iteration = 3 status = 0
3712024-12-06T20:45:29.042ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3722024-12-06T20:45:29.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3732024-12-06T20:45:29.044ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3742024-12-06T20:45:29.045ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3752024-12-06T20:45:29.045ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
3762024-12-06T20:45:29.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3772024-12-06T20:45:29.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3782024-12-06T20:45:29.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3792024-12-06T20:45:29.046ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3802024-12-06T20:45:29.046ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3812024-12-06T20:45:29.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3822024-12-06T20:45:29.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3832024-12-06T20:45:29.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3842024-12-06T20:45:29.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3852024-12-06T20:45:29.052ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 196.704351ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3862024-12-06T20:45:29.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3872024-12-06T20:45:29.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3882024-12-06T20:45:29.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3892024-12-06T20:45:29.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3902024-12-06T20:45:29.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3912024-12-06T20:45:29.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3922024-12-06T20:45:29.061ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
3932024-12-06T20:45:29.061ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3942024-12-06T20:45:29.061ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
3952024-12-06T20:45:29.061ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 205.164389ms iteration = 2 status = {"generation":2}
3962024-12-06T20:45:29.061ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
3972024-12-06T20:45:29.063ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3982024-12-06T20:45:29.063ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ee04cd8-448f-4544-bb3b-29721fde7bdb", "content-length": "1", "date": "Fri, 06 Dec 2024 20:45:28 GMT"} })
3992024-12-06T20:45:29.064ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4002024-12-06T20:45:29.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4012024-12-06T20:45:29.072ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4022024-12-06T20:45:29.072ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
4032024-12-06T20:45:29.072ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 215.70039ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
4042024-12-06T20:45:29.096ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 240.217312ms iteration = 5 status = {"physical_disks_added":0}
4052024-12-06T20:45:29.119ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
4062024-12-06T20:45:29.119ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 263.711158ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4072024-12-06T20:45:29.126ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4082024-12-06T20:45:29.126ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 269.719463ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4092024-12-06T20:45:29.164ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
4102024-12-06T20:45:29.164ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4112024-12-06T20:45:29.165ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f8fb098-8940-400a-a3fd-c79496be5612", "content-length": "26", "date": "Fri, 06 Dec 2024 20:45:28 GMT"} })
4122024-12-06T20:45:29.165ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4132024-12-06T20:45:29.166ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4142024-12-06T20:45:29.166ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4152024-12-06T20:45:29.166ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "06da8a72-9d37-4dc5-816c-8a4e0627e6f9", "content-length": "372", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} })
4162024-12-06T20:45:29.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4172024-12-06T20:45:29.166ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
4182024-12-06T20:45:29.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4192024-12-06T20:45:29.168ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 311.742016ms iteration = 3 status = {}
4202024-12-06T20:45:29.168ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
4212024-12-06T20:45:29.168ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
4222024-12-06T20:45:29.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4232024-12-06T20:45:29.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4242024-12-06T20:45:29.169ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 314.156359ms iteration = 3 status = null
4252024-12-06T20:45:29.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4262024-12-06T20:45:29.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4272024-12-06T20:45:29.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4282024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
4292024-12-06T20:45:29.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4302024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
4312024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
4322024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
4332024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
4342024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
4352024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
4362024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
4372024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
4382024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
4392024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
4402024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
4412024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
4422024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
4432024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
4442024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
4452024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
4462024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
4472024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
4482024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
4492024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
4502024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
4512024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
4522024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
4532024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
4542024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
4552024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
4562024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
4572024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
4582024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
4592024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
4602024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
4612024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
4622024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
4632024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
4642024-12-06T20:45:29.174ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
4652024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
4662024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
4672024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
4682024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
4692024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
4702024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
4712024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
4722024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
4732024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
4742024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
4752024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
4762024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
4772024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
4782024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
4792024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
4802024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
4812024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
4822024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
4832024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
4842024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
4852024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
4862024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
4872024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
4882024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
4892024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
4902024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
4912024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
4922024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
4932024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
4942024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
4952024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
4962024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
4972024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
4982024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
4992024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
5002024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
5012024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
5022024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
5032024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
5042024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
5052024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
5062024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
5072024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
5082024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
5092024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
5102024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
5112024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
5122024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
5132024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
5142024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
5152024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
5162024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
5172024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
5182024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
5192024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
5202024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
5212024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
5222024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
5232024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
5242024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
5252024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
5262024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
5272024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
5282024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
5292024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
5302024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
5312024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
5322024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
5332024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
5342024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
5352024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
5362024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
5372024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
5382024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
5392024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
5402024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
5412024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
5422024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
5432024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
5442024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
5452024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
5462024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
5472024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
5482024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
5492024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
5502024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
5512024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
5522024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
5532024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
5542024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
5552024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
5562024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
5572024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
5582024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
5592024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
5602024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
5612024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
5622024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
5632024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
5642024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
5652024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
5662024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
5672024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
5682024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
5692024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
5702024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
5712024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
5722024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
5732024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
5742024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
5752024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
5762024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
5772024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
5782024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
5792024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
5802024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
5812024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
5822024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
5832024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
5842024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
5852024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
5862024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
5872024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
5882024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
5892024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
5902024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
5912024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
5922024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
5932024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
5942024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
5952024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
5962024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
5972024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
5982024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
5992024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
6002024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
6012024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
6022024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
6032024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
6042024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
6052024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
6062024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
6072024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
6082024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
6092024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
6102024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
6112024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
6122024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
6132024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
6142024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
6152024-12-06T20:45:29.175ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
6162024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
6172024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
6182024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
6192024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
6202024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
6212024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
6222024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
6232024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
6242024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
6252024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
6262024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
6272024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
6282024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
6292024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
6302024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
6312024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
6322024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
6332024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
6342024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
6352024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
6362024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
6372024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
6382024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
6392024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
6402024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
6412024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
6422024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
6432024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
6442024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
6452024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
6462024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
6472024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
6482024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
6492024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
6502024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
6512024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
6522024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
6532024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
6542024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
6552024-12-06T20:45:29.176ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.7:443
6562024-12-06T20:45:29.176ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
6572024-12-06T20:45:29.176ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
6582024-12-06T20:45:29.183ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
6592024-12-06T20:45:29.183ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
6602024-12-06T20:45:29.183ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
6612024-12-06T20:45:29.183ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
6622024-12-06T20:45:29.183ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
6632024-12-06T20:45:29.183ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
6642024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
6652024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
6662024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
6672024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
6682024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
6692024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
6702024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
6712024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
6722024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
6732024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
6742024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
6752024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
6762024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
6772024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
6782024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
6792024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
6802024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
6812024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
6822024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
6832024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
6842024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
6852024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
6862024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
6872024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
6882024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
6892024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
6902024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
6912024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
6922024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
6932024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
6942024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
6952024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
6962024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
6972024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
6982024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
6992024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
7002024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
7012024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
7022024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
7032024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
7042024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
7052024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
7062024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
7072024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
7082024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
7092024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
7102024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
7112024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
7122024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
7132024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
7142024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
7152024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
7162024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
7172024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
7182024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
7192024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
7202024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
7212024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
7222024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
7232024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
7242024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
7252024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
7262024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
7272024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
7282024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
7292024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
7302024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
7312024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
7322024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
7332024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
7342024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
7352024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
7362024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
7372024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
7382024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
7392024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
7402024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
7412024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
7422024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
7432024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
7442024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
7452024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
7462024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
7472024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
7482024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
7492024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
7502024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
7512024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
7522024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
7532024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
7542024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
7552024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
7562024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
7572024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
7582024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
7592024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
7602024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
7612024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
7622024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
7632024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
7642024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
7652024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
7662024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
7672024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
7682024-12-06T20:45:29.184ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
7692024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
7702024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
7712024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
7722024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
7732024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
7742024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
7752024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
7762024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
7772024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
7782024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
7792024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
7802024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
7812024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
7822024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
7832024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
7842024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
7852024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
7862024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
7872024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
7882024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
7892024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
7902024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
7912024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
7922024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
7932024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
7942024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
7952024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
7962024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
7972024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
7982024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
7992024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
8002024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
8012024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
8022024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
8032024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
8042024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
8052024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
8062024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
8072024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
8082024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
8092024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
8102024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
8112024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
8122024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
8132024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
8142024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
8152024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
8162024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
8172024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
8182024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
8192024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
8202024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
8212024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
8222024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
8232024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
8242024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
8252024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
8262024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
8272024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
8282024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
8292024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
8302024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
8312024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
8322024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
8332024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
8342024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
8352024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
8362024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
8372024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
8382024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
8392024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
8402024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
8412024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
8422024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
8432024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
8442024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
8452024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
8462024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
8472024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
8482024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
8492024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
8502024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
8512024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
8522024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
8532024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
8542024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
8552024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
8562024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
8572024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
8582024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
8592024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
8602024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
8612024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
8622024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
8632024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
8642024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
8652024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
8662024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
8672024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
8682024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
8692024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
8702024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
8712024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
8722024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
8732024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
8742024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
8752024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
8762024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
8772024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
8782024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
8792024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
8802024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
8812024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
8822024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
8832024-12-06T20:45:29.185ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
8842024-12-06T20:45:29.185ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12228
8852024-12-06T20:45:29.186ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
8862024-12-06T20:45:29.190ZDEBGnexus (nexus-producer-server): registered DTrace probes
8872024-12-06T20:45:29.193ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
8882024-12-06T20:45:29.193ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
8892024-12-06T20:45:29.193ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
8902024-12-06T20:45:29.193ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 337.880881ms iteration = 2 status = {"generation":1}
8912024-12-06T20:45:29.193ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
8922024-12-06T20:45:29.194ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:51868 method = GET path = /{producer_id} versions = all
8932024-12-06T20:45:29.196ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:51868
8942024-12-06T20:45:29.196ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:51868
8952024-12-06T20:45:29.196ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:51868
8962024-12-06T20:45:29.196ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
8972024-12-06T20:45:29.196ZDEBGnexus (nexus-producer-server): starting producer registration task
8982024-12-06T20:45:29.196ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:51868 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
8992024-12-06T20:45:29.196ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
9002024-12-06T20:45:29.196ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
9012024-12-06T20:45:29.224ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
9022024-12-06T20:45:29.224ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9032024-12-06T20:45:29.225ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ee821026-3981-4e13-9d59-adcf03419d02", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} })
9042024-12-06T20:45:29.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9052024-12-06T20:45:29.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9062024-12-06T20:45:29.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9072024-12-06T20:45:29.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9082024-12-06T20:45:29.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9092024-12-06T20:45:29.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9102024-12-06T20:45:29.236ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9112024-12-06T20:45:29.236ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9122024-12-06T20:45:29.236ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9b7e1a8b-0fa3-48e9-80bd-88a25d4dfb57", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} })
9132024-12-06T20:45:29.238ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 382.000978ms iteration = 3 status = {}
9142024-12-06T20:45:29.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9152024-12-06T20:45:29.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9162024-12-06T20:45:29.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9172024-12-06T20:45:29.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9182024-12-06T20:45:29.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9192024-12-06T20:45:29.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9202024-12-06T20:45:29.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9212024-12-06T20:45:29.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9222024-12-06T20:45:29.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9232024-12-06T20:45:29.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9242024-12-06T20:45:29.285ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
9252024-12-06T20:45:29.286ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "48589ccb-13f7-413a-9f9a-988e990e05e5", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
9262024-12-06T20:45:29.286ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
9272024-12-06T20:45:29.287ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "744281ea-76d1-4d50-a127-4a085a456959", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
9282024-12-06T20:45:29.287ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
9292024-12-06T20:45:29.288ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
9302024-12-06T20:45:29.290ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 229.776934ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
9312024-12-06T20:45:29.298ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
9322024-12-06T20:45:29.306ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
9332024-12-06T20:45:29.306ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:54361
9342024-12-06T20:45:29.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54361 req_id = 496887ba-7362-4001-bed6-0a7073a7220a roles = RoleSet { roles: {} } uri = /metrics/producers
9352024-12-06T20:45:29.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54361 req_id = 496887ba-7362-4001-bed6-0a7073a7220a resource = Database result = Ok(()) uri = /metrics/producers
9362024-12-06T20:45:29.358ZINFOnexus: assigned collector to new producer collector_id = bef145b4-2934-45c3-870a-63d45572bde4 file = nexus/src/app/oximeter.rs:76 producer_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
9372024-12-06T20:45:29.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53846 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54361 req_id = 496887ba-7362-4001-bed6-0a7073a7220a response_code = 201 uri = /metrics/producers
9382024-12-06T20:45:29.360ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "496887ba-7362-4001-bed6-0a7073a7220a", "content-length": "41", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} })
9392024-12-06T20:45:29.363ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9402024-12-06T20:45:29.363ZDEBGnexus (producer-registration-task): registered with nexus successfully
9412024-12-06T20:45:29.363ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
9422024-12-06T20:45:29.363ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "df2fe8bf-ca41-4bf9-9941-232e3744a3bb", "content-length": "691", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} })
9432024-12-06T20:45:29.363ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
9442024-12-06T20:45:29.363ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
9452024-12-06T20:45:29.363ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
9462024-12-06T20:45:29.365ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 508.677154ms iteration = 3 status = {}
9472024-12-06T20:45:29.371ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
9482024-12-06T20:45:29.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9492024-12-06T20:45:29.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9502024-12-06T20:45:29.397ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
9512024-12-06T20:45:29.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9522024-12-06T20:45:29.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9532024-12-06T20:45:29.406ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
9542024-12-06T20:45:29.406ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf405dad-944f-43bf-91d0-89745905ddef", "content-length": "134", "date": "Fri, 06 Dec 2024 20:45:28 GMT"} })
9552024-12-06T20:45:29.406ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
9562024-12-06T20:45:29.406ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
9572024-12-06T20:45:29.407ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
9582024-12-06T20:45:29.407ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9592024-12-06T20:45:29.407ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9602024-12-06T20:45:29.407ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9612024-12-06T20:45:29.407ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9622024-12-06T20:45:29.407ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9632024-12-06T20:45:29.407ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9642024-12-06T20:45:29.407ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9652024-12-06T20:45:29.407ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
9662024-12-06T20:45:29.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9672024-12-06T20:45:29.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9682024-12-06T20:45:29.408ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
9692024-12-06T20:45:29.408ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "634b9d0d-a7e9-4a80-97fb-e1af6ec298f8", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
9702024-12-06T20:45:29.408ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
9712024-12-06T20:45:29.409ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "47c1ad99-fb2c-477f-8076-e17ca80fba30", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
9722024-12-06T20:45:29.409ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
9732024-12-06T20:45:29.410ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9742024-12-06T20:45:29.410ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "54d4d3e3-d1e2-4717-9c22-83cc1f4d27b1", "content-length": "2", "date": "Fri, 06 Dec 2024 20:45:28 GMT"} })
9752024-12-06T20:45:29.410ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9762024-12-06T20:45:29.410ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0afd11b-9314-4e32-b8ac-297c3e8c0eb5", "content-length": "52", "date": "Fri, 06 Dec 2024 20:45:28 GMT"} })
9772024-12-06T20:45:29.410ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
9782024-12-06T20:45:29.410ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9792024-12-06T20:45:29.410ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9ad10ec1-0204-4221-b31e-695fe3e1cc38", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
9802024-12-06T20:45:29.410ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
9812024-12-06T20:45:29.411ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
9822024-12-06T20:45:29.411ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 218.00151ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
9832024-12-06T20:45:29.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 25e37928-5959-4ed6-a199-bdf235325e22 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
9842024-12-06T20:45:29.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 25e37928-5959-4ed6-a199-bdf235325e22 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
9852024-12-06T20:45:29.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 25e37928-5959-4ed6-a199-bdf235325e22 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
9862024-12-06T20:45:29.560ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3fed4490-6464-4fb5-8cb8-587be5848a0e", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} })
9872024-12-06T20:45:29.560ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
9882024-12-06T20:45:29.560ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9892024-12-06T20:45:29.560ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b48372b-19eb-49a2-9779-b49c306375f4", "content-length": "682", "date": "Fri, 06 Dec 2024 20:45:29 GMT"} })
9902024-12-06T20:45:29.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9912024-12-06T20:45:29.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9922024-12-06T20:45:29.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9932024-12-06T20:45:29.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9942024-12-06T20:45:29.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9952024-12-06T20:45:29.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9962024-12-06T20:45:29.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9972024-12-06T20:45:29.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9982024-12-06T20:45:29.759ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 902.905227ms iteration = 3 status = {}
9992024-12-06T20:45:30.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a2ddecf5-12f2-48e8-bcf2-99b62fb0a516 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10002024-12-06T20:45:30.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a2ddecf5-12f2-48e8-bcf2-99b62fb0a516 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10012024-12-06T20:45:30.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a2ddecf5-12f2-48e8-bcf2-99b62fb0a516 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10022024-12-06T20:45:31.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3a1d3ee7-24e1-4f19-9f09-8222eda1210d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10032024-12-06T20:45:31.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3a1d3ee7-24e1-4f19-9f09-8222eda1210d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10042024-12-06T20:45:31.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2786 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3a1d3ee7-24e1-4f19-9f09-8222eda1210d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10052024-12-06T20:45:32.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aa19dec6-5299-45e8-a30c-8eef590bc696 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10062024-12-06T20:45:32.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aa19dec6-5299-45e8-a30c-8eef590bc696 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10072024-12-06T20:45:32.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aa19dec6-5299-45e8-a30c-8eef590bc696 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10082024-12-06T20:45:33.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f01298f3-d48c-497e-b012-8e064f56c2aa roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10092024-12-06T20:45:33.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f01298f3-d48c-497e-b012-8e064f56c2aa resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10102024-12-06T20:45:33.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f01298f3-d48c-497e-b012-8e064f56c2aa response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10112024-12-06T20:45:34.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 53f3f921-5d54-4fc4-a307-a6acdd110384 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10122024-12-06T20:45:34.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 53f3f921-5d54-4fc4-a307-a6acdd110384 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10132024-12-06T20:45:34.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 53f3f921-5d54-4fc4-a307-a6acdd110384 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10142024-12-06T20:45:35.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = efc4a36a-ce4c-401d-a787-c60a8d05f48c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10152024-12-06T20:45:35.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = efc4a36a-ce4c-401d-a787-c60a8d05f48c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10162024-12-06T20:45:35.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = efc4a36a-ce4c-401d-a787-c60a8d05f48c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10172024-12-06T20:45:36.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 90f5a32b-9535-406f-9865-a8ac9b67ccbe roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10182024-12-06T20:45:36.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 90f5a32b-9535-406f-9865-a8ac9b67ccbe resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10192024-12-06T20:45:36.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 90f5a32b-9535-406f-9865-a8ac9b67ccbe response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10202024-12-06T20:45:37.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 618b1c9f-72c2-414c-94a2-ef77f1afaa72 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10212024-12-06T20:45:37.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 618b1c9f-72c2-414c-94a2-ef77f1afaa72 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10222024-12-06T20:45:37.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 618b1c9f-72c2-414c-94a2-ef77f1afaa72 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10232024-12-06T20:45:38.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 83630ac2-3509-47b0-ad5f-411489073c5a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10242024-12-06T20:45:38.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 83630ac2-3509-47b0-ad5f-411489073c5a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10252024-12-06T20:45:38.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 83630ac2-3509-47b0-ad5f-411489073c5a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10262024-12-06T20:45:38.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
10272024-12-06T20:45:38.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
10282024-12-06T20:45:38.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10292024-12-06T20:45:38.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10302024-12-06T20:45:38.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10312024-12-06T20:45:38.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10322024-12-06T20:45:38.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10332024-12-06T20:45:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10342024-12-06T20:45:38.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10352024-12-06T20:45:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10362024-12-06T20:45:38.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10372024-12-06T20:45:38.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10382024-12-06T20:45:38.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10392024-12-06T20:45:38.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
10402024-12-06T20:45:38.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10412024-12-06T20:45:38.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10422024-12-06T20:45:38.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
10432024-12-06T20:45:38.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.022686ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
10442024-12-06T20:45:38.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10452024-12-06T20:45:38.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10462024-12-06T20:45:38.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.854408ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10472024-12-06T20:45:39.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d7beab82-d7cd-454b-8a82-93b61f1ed7be roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10482024-12-06T20:45:39.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d7beab82-d7cd-454b-8a82-93b61f1ed7be resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10492024-12-06T20:45:39.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d7beab82-d7cd-454b-8a82-93b61f1ed7be response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10502024-12-06T20:45:40.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 68ffdb80-f944-49ae-8d79-fc1cb9e23d11 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10512024-12-06T20:45:40.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 68ffdb80-f944-49ae-8d79-fc1cb9e23d11 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10522024-12-06T20:45:40.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 68ffdb80-f944-49ae-8d79-fc1cb9e23d11 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10532024-12-06T20:45:41.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 39298ec8-d70a-4c50-b627-cdf9e4987c72 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10542024-12-06T20:45:41.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 39298ec8-d70a-4c50-b627-cdf9e4987c72 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10552024-12-06T20:45:41.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 39298ec8-d70a-4c50-b627-cdf9e4987c72 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10562024-12-06T20:45:42.515ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:51868 remote_addr = [fd00:1122:3344:101::d]:47103
10572024-12-06T20:45:42.520ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5208 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = e8b0015b-3aa5-4969-a6e1-b6d165df60b3 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
10582024-12-06T20:45:42.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 20365f01-10b8-487b-bd82-af77d20c3277 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10592024-12-06T20:45:42.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 20365f01-10b8-487b-bd82-af77d20c3277 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10602024-12-06T20:45:42.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 20365f01-10b8-487b-bd82-af77d20c3277 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10612024-12-06T20:45:43.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d8df5655-3f10-4bcb-b305-5469899fc53e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10622024-12-06T20:45:43.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d8df5655-3f10-4bcb-b305-5469899fc53e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10632024-12-06T20:45:43.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d8df5655-3f10-4bcb-b305-5469899fc53e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10642024-12-06T20:45:44.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 963c644d-bdc6-4a33-bcab-7afbe9bcc199 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10652024-12-06T20:45:44.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 963c644d-bdc6-4a33-bcab-7afbe9bcc199 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10662024-12-06T20:45:44.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 963c644d-bdc6-4a33-bcab-7afbe9bcc199 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10672024-12-06T20:45:45.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 22b2ce56-281b-4cf9-b858-e6f6f070cd1f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10682024-12-06T20:45:45.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 22b2ce56-281b-4cf9-b858-e6f6f070cd1f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10692024-12-06T20:45:45.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 22b2ce56-281b-4cf9-b858-e6f6f070cd1f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10702024-12-06T20:45:46.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1266e3d4-aa54-48e4-b662-a68d23d2a59f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10712024-12-06T20:45:46.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1266e3d4-aa54-48e4-b662-a68d23d2a59f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10722024-12-06T20:45:46.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1266e3d4-aa54-48e4-b662-a68d23d2a59f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10732024-12-06T20:45:47.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 752aa43b-8fcc-4446-8dde-c38f0108e567 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10742024-12-06T20:45:47.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 752aa43b-8fcc-4446-8dde-c38f0108e567 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10752024-12-06T20:45:47.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 752aa43b-8fcc-4446-8dde-c38f0108e567 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10762024-12-06T20:45:48.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
10772024-12-06T20:45:48.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
10782024-12-06T20:45:48.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10792024-12-06T20:45:48.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10802024-12-06T20:45:48.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10812024-12-06T20:45:48.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10822024-12-06T20:45:48.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10832024-12-06T20:45:48.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10842024-12-06T20:45:48.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852024-12-06T20:45:48.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10862024-12-06T20:45:48.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10872024-12-06T20:45:48.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10882024-12-06T20:45:48.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10892024-12-06T20:45:48.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10902024-12-06T20:45:48.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10912024-12-06T20:45:48.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
10922024-12-06T20:45:48.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10932024-12-06T20:45:48.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10942024-12-06T20:45:48.881ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
10952024-12-06T20:45:48.881ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.695067ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
10962024-12-06T20:45:48.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.402884ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10972024-12-06T20:45:48.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aa50c899-3103-48e0-85dd-32b73e0ef212 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10982024-12-06T20:45:48.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aa50c899-3103-48e0-85dd-32b73e0ef212 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
10992024-12-06T20:45:48.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aa50c899-3103-48e0-85dd-32b73e0ef212 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11002024-12-06T20:45:49.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d5fe8197-fe3c-4d62-986f-985540fa1f8e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11012024-12-06T20:45:49.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d5fe8197-fe3c-4d62-986f-985540fa1f8e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11022024-12-06T20:45:49.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d5fe8197-fe3c-4d62-986f-985540fa1f8e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11032024-12-06T20:45:51.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 00118ad3-dfcd-4628-9fcb-a0ffe2875cf8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11042024-12-06T20:45:51.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 00118ad3-dfcd-4628-9fcb-a0ffe2875cf8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11052024-12-06T20:45:51.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 00118ad3-dfcd-4628-9fcb-a0ffe2875cf8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11062024-12-06T20:45:52.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de428f98-acad-4436-b5d7-9443ef58aaca roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11072024-12-06T20:45:52.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de428f98-acad-4436-b5d7-9443ef58aaca resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11082024-12-06T20:45:52.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de428f98-acad-4436-b5d7-9443ef58aaca response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11092024-12-06T20:45:52.417ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 63c363fd-73f0-4a1d-86bb-ad7ecc65a0be response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
11102024-12-06T20:45:53.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 288ea48c-ea49-4cef-b733-de8aec9cc44e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11112024-12-06T20:45:53.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 288ea48c-ea49-4cef-b733-de8aec9cc44e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11122024-12-06T20:45:53.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 288ea48c-ea49-4cef-b733-de8aec9cc44e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11132024-12-06T20:45:54.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d0c2c3db-31ae-48fb-9e5c-f9bab2dfe4f3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11142024-12-06T20:45:54.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d0c2c3db-31ae-48fb-9e5c-f9bab2dfe4f3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11152024-12-06T20:45:54.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d0c2c3db-31ae-48fb-9e5c-f9bab2dfe4f3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11162024-12-06T20:45:55.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 22f2c53d-7d6b-45ad-85ff-08fedff4ddd9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11172024-12-06T20:45:55.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 22f2c53d-7d6b-45ad-85ff-08fedff4ddd9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11182024-12-06T20:45:55.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 22f2c53d-7d6b-45ad-85ff-08fedff4ddd9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11192024-12-06T20:45:56.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2c83ee90-535f-480d-aa21-a88777fbd080 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11202024-12-06T20:45:56.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2c83ee90-535f-480d-aa21-a88777fbd080 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11212024-12-06T20:45:56.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2c83ee90-535f-480d-aa21-a88777fbd080 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11222024-12-06T20:45:57.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75f6e616-d202-4e4b-b463-e3f240f52b93 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11232024-12-06T20:45:57.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75f6e616-d202-4e4b-b463-e3f240f52b93 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11242024-12-06T20:45:57.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75f6e616-d202-4e4b-b463-e3f240f52b93 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11252024-12-06T20:45:57.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 0ed9b61b-c79e-4ce7-ae8f-61ee337b66fd roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
11262024-12-06T20:45:57.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 0ed9b61b-c79e-4ce7-ae8f-61ee337b66fd resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
11272024-12-06T20:45:57.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 0ed9b61b-c79e-4ce7-ae8f-61ee337b66fd response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
11282024-12-06T20:45:57.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 85ae1dc5-831e-4c6c-b052-16761dcdf81d roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
11292024-12-06T20:45:57.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 85ae1dc5-831e-4c6c-b052-16761dcdf81d resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
11302024-12-06T20:45:57.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 85ae1dc5-831e-4c6c-b052-16761dcdf81d response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
11312024-12-06T20:45:58.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 61e14d3e-acb4-4649-b401-91afa64b9d7f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11322024-12-06T20:45:58.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 61e14d3e-acb4-4649-b401-91afa64b9d7f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11332024-12-06T20:45:58.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 61e14d3e-acb4-4649-b401-91afa64b9d7f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
11342024-12-06T20:45:58.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
11352024-12-06T20:45:58.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11362024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11372024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
11382024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11392024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
11402024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
11412024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11422024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11432024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
11442024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
11452024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11462024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11472024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
11482024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
11492024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11502024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11512024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
11522024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11532024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
11542024-12-06T20:45:58.856ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
11552024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
11562024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11572024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11582024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
11592024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
11602024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
11612024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11622024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
11632024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
11642024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
11652024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
11662024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11672024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
11682024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
11692024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11702024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11712024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11722024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11732024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11742024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11752024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11762024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11772024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11782024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11792024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11802024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11812024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11822024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11832024-12-06T20:45:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11842024-12-06T20:45:58.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11852024-12-06T20:45:58.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6289, tv_nsec: 195005699 } })
11862024-12-06T20:45:58.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
11872024-12-06T20:45:58.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11882024-12-06T20:45:58.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11892024-12-06T20:45:58.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11902024-12-06T20:45:58.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11912024-12-06T20:45:58.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6289, tv_nsec: 196894898 } })
11922024-12-06T20:45:58.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
11932024-12-06T20:45:58.860ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.960362ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11942024-12-06T20:45:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11952024-12-06T20:45:58.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11962024-12-06T20:45:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11972024-12-06T20:45:58.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11982024-12-06T20:45:58.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11992024-12-06T20:45:58.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12002024-12-06T20:45:58.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12012024-12-06T20:45:58.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12022024-12-06T20:45:58.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12032024-12-06T20:45:58.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12042024-12-06T20:45:58.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12052024-12-06T20:45:58.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12062024-12-06T20:45:58.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12072024-12-06T20:45:58.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12082024-12-06T20:45:58.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12092024-12-06T20:45:58.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12102024-12-06T20:45:58.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12112024-12-06T20:45:58.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12122024-12-06T20:45:58.873ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12132024-12-06T20:45:58.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12142024-12-06T20:45:58.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12152024-12-06T20:45:58.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12162024-12-06T20:45:58.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12172024-12-06T20:45:58.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12182024-12-06T20:45:58.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12192024-12-06T20:45:58.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12202024-12-06T20:45:58.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12212024-12-06T20:45:58.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12222024-12-06T20:45:58.891ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12232024-12-06T20:45:58.891ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.903199ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12242024-12-06T20:45:58.908ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12252024-12-06T20:45:58.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12262024-12-06T20:45:58.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.760617ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
12272024-12-06T20:45:58.919ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12282024-12-06T20:45:58.919ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12292024-12-06T20:45:58.919ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12302024-12-06T20:45:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12312024-12-06T20:45:58.919ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12322024-12-06T20:45:58.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12332024-12-06T20:45:58.920ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12342024-12-06T20:45:58.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12352024-12-06T20:45:58.922ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12362024-12-06T20:45:58.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12372024-12-06T20:45:58.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.289829ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12382024-12-06T20:45:58.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.850813ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12392024-12-06T20:45:58.925ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12402024-12-06T20:45:58.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12412024-12-06T20:45:58.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12422024-12-06T20:45:58.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12432024-12-06T20:45:58.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12442024-12-06T20:45:58.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 71.972995ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
12452024-12-06T20:45:58.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12462024-12-06T20:45:58.928ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
12472024-12-06T20:45:58.928ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12482024-12-06T20:45:58.928ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11e887fa-1777-4457-a277-d91ed7d4bfc5", "content-length": "26", "date": "Fri, 06 Dec 2024 20:45:58 GMT"} })
12492024-12-06T20:45:58.928ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12502024-12-06T20:45:58.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.039233ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
12512024-12-06T20:45:58.930ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6289, tv_nsec: 267228921 } })
12522024-12-06T20:45:58.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12532024-12-06T20:45:58.930ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12542024-12-06T20:45:58.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12552024-12-06T20:45:58.930ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
12562024-12-06T20:45:58.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12572024-12-06T20:45:58.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
12582024-12-06T20:45:58.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12592024-12-06T20:45:58.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12602024-12-06T20:45:58.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12612024-12-06T20:45:58.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
12622024-12-06T20:45:58.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12632024-12-06T20:45:58.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12642024-12-06T20:45:58.939ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.374159ms iteration = 4 status = 0
12652024-12-06T20:45:58.953ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
12662024-12-06T20:45:58.953ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.306108ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
12672024-12-06T20:45:58.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.004395ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
12682024-12-06T20:45:58.963ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12692024-12-06T20:45:58.963ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12702024-12-06T20:45:58.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12712024-12-06T20:45:58.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12722024-12-06T20:45:58.987ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12732024-12-06T20:45:58.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12742024-12-06T20:45:58.989ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12752024-12-06T20:45:58.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12762024-12-06T20:45:58.991ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12772024-12-06T20:45:58.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12782024-12-06T20:45:58.993ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
12792024-12-06T20:45:58.993ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12802024-12-06T20:45:58.993ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbf86847-4caf-4ac6-a1f3-ed1f99e43382", "content-length": "26", "date": "Fri, 06 Dec 2024 20:45:58 GMT"} })
12812024-12-06T20:45:58.993ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12822024-12-06T20:45:58.995ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12832024-12-06T20:45:59.003ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12842024-12-06T20:45:59.003ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12852024-12-06T20:45:59.003ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.355029ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12862024-12-06T20:45:59.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12872024-12-06T20:45:59.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12882024-12-06T20:45:59.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12892024-12-06T20:45:59.025ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12902024-12-06T20:45:59.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12912024-12-06T20:45:59.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12922024-12-06T20:45:59.026ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12932024-12-06T20:45:59.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12942024-12-06T20:45:59.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12952024-12-06T20:45:59.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12962024-12-06T20:45:59.045ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12972024-12-06T20:45:59.045ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "00840387-87bc-4990-af5b-3644731c144e", "content-length": "1", "date": "Fri, 06 Dec 2024 20:45:58 GMT"} })
12982024-12-06T20:45:59.047ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12992024-12-06T20:45:59.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13002024-12-06T20:45:59.049ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 194.163306ms iteration = 4 status = null
13012024-12-06T20:45:59.072ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
13022024-12-06T20:45:59.072ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13032024-12-06T20:45:59.072ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8490ffd-9ef8-4d86-a60b-20ea2b0916eb", "content-length": "26", "date": "Fri, 06 Dec 2024 20:45:58 GMT"} })
13042024-12-06T20:45:59.072ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13052024-12-06T20:45:59.073ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
13062024-12-06T20:45:59.077ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13072024-12-06T20:45:59.077ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13082024-12-06T20:45:59.078ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e2bf736-93dd-42e2-9130-92bfdb8724d2", "content-length": "372", "date": "Fri, 06 Dec 2024 20:45:59 GMT"} })
13092024-12-06T20:45:59.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13102024-12-06T20:45:59.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13112024-12-06T20:45:59.089ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 232.824412ms iteration = 4 status = {}
13122024-12-06T20:45:59.089ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 233.321645ms iteration = 6 status = {"physical_disks_added":0}
13132024-12-06T20:45:59.096ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
13142024-12-06T20:45:59.096ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13152024-12-06T20:45:59.096ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d952dfa8-b322-468d-9392-a4feb3c1b0d4", "date": "Fri, 06 Dec 2024 20:45:59 GMT"} })
13162024-12-06T20:45:59.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13172024-12-06T20:45:59.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13182024-12-06T20:45:59.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13192024-12-06T20:45:59.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13202024-12-06T20:45:59.137ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13212024-12-06T20:45:59.137ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "92a8354f-0bb4-49d3-98d8-185106bad9ba", "content-length": "691", "date": "Fri, 06 Dec 2024 20:45:59 GMT"} })
13222024-12-06T20:45:59.137ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
13232024-12-06T20:45:59.137ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
13242024-12-06T20:45:59.137ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
13252024-12-06T20:45:59.138ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 282.104843ms iteration = 4 status = {}
13262024-12-06T20:45:59.140ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13272024-12-06T20:45:59.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13282024-12-06T20:45:59.143ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13292024-12-06T20:45:59.143ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13302024-12-06T20:45:59.143ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a99b1cb9-e496-4936-915d-44c6c3f59aa5", "date": "Fri, 06 Dec 2024 20:45:59 GMT"} })
13312024-12-06T20:45:59.144ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.035136ms iteration = 4 status = {}
13322024-12-06T20:45:59.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9cb1ccb3-14d0-4819-9c2a-eaf84803ca23 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13332024-12-06T20:45:59.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9cb1ccb3-14d0-4819-9c2a-eaf84803ca23 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13342024-12-06T20:45:59.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9cb1ccb3-14d0-4819-9c2a-eaf84803ca23 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13352024-12-06T20:45:59.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13362024-12-06T20:45:59.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13372024-12-06T20:45:59.184ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
13382024-12-06T20:45:59.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13392024-12-06T20:45:59.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13402024-12-06T20:45:59.338ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13412024-12-06T20:45:59.338ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5280026f-107f-49e9-86cf-41b2220640c1", "content-length": "134", "date": "Fri, 06 Dec 2024 20:45:58 GMT"} })
13422024-12-06T20:45:59.338ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
13432024-12-06T20:45:59.338ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
13442024-12-06T20:45:59.339ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13452024-12-06T20:45:59.339ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13462024-12-06T20:45:59.339ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13472024-12-06T20:45:59.339ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13482024-12-06T20:45:59.339ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13492024-12-06T20:45:59.339ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13502024-12-06T20:45:59.339ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13512024-12-06T20:45:59.339ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13522024-12-06T20:45:59.339ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
13532024-12-06T20:45:59.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13542024-12-06T20:45:59.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13552024-12-06T20:45:59.341ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13562024-12-06T20:45:59.341ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0443477-0d27-4bf2-ab28-c4dc6f26cd59", "content-length": "2", "date": "Fri, 06 Dec 2024 20:45:58 GMT"} })
13572024-12-06T20:45:59.341ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13582024-12-06T20:45:59.341ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "aafdefdf-e98b-41d3-ace5-d6137f354547", "content-length": "52", "date": "Fri, 06 Dec 2024 20:45:58 GMT"} })
13592024-12-06T20:45:59.341ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
13602024-12-06T20:45:59.342ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13612024-12-06T20:45:59.485ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d6901eb1-4e07-4df7-abcd-34431f77ecb9", "date": "Fri, 06 Dec 2024 20:45:59 GMT"} })
13622024-12-06T20:45:59.485ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
13632024-12-06T20:45:59.485ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13642024-12-06T20:45:59.485ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "809ded60-aa47-40ce-b8b9-98b8a28d2f32", "content-length": "682", "date": "Fri, 06 Dec 2024 20:45:59 GMT"} })
13652024-12-06T20:45:59.485ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13662024-12-06T20:45:59.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13672024-12-06T20:45:59.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13682024-12-06T20:45:59.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13692024-12-06T20:45:59.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13702024-12-06T20:45:59.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13712024-12-06T20:45:59.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13722024-12-06T20:45:59.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13732024-12-06T20:45:59.514ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 658.521727ms iteration = 4 status = {}
13742024-12-06T20:46:00.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d576c00d-1f54-4fcf-a7db-ff1f98f29473 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13752024-12-06T20:46:00.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d576c00d-1f54-4fcf-a7db-ff1f98f29473 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13762024-12-06T20:46:00.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d576c00d-1f54-4fcf-a7db-ff1f98f29473 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13772024-12-06T20:46:01.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2bd23926-5bcb-4e99-9547-f07207694659 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13782024-12-06T20:46:01.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2bd23926-5bcb-4e99-9547-f07207694659 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13792024-12-06T20:46:01.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2bd23926-5bcb-4e99-9547-f07207694659 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13802024-12-06T20:46:02.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a92fc1cb-8780-4f35-9d10-aefcc8f4aebb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13812024-12-06T20:46:02.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a92fc1cb-8780-4f35-9d10-aefcc8f4aebb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13822024-12-06T20:46:02.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a92fc1cb-8780-4f35-9d10-aefcc8f4aebb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13832024-12-06T20:46:02.416ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 446 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 1687b390-5d3f-415c-8ad1-21d7d54cd240 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
13842024-12-06T20:46:03.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 047dd26a-e097-4a5d-9629-f15018d97236 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13852024-12-06T20:46:03.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 047dd26a-e097-4a5d-9629-f15018d97236 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13862024-12-06T20:46:03.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 047dd26a-e097-4a5d-9629-f15018d97236 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13872024-12-06T20:46:04.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eada2c2e-d733-44d5-84d6-3a929fb147c8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13882024-12-06T20:46:04.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eada2c2e-d733-44d5-84d6-3a929fb147c8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13892024-12-06T20:46:04.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eada2c2e-d733-44d5-84d6-3a929fb147c8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13902024-12-06T20:46:05.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc8e9bc9-a2c1-475e-95aa-169c526bb256 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13912024-12-06T20:46:05.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc8e9bc9-a2c1-475e-95aa-169c526bb256 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13922024-12-06T20:46:05.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc8e9bc9-a2c1-475e-95aa-169c526bb256 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13932024-12-06T20:46:06.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ed41b6a6-463c-4594-b39c-12ced9f0d8df roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13942024-12-06T20:46:06.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ed41b6a6-463c-4594-b39c-12ced9f0d8df resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13952024-12-06T20:46:06.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ed41b6a6-463c-4594-b39c-12ced9f0d8df response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13962024-12-06T20:46:07.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1f3ac266-d332-425c-9303-b5b79879be98 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13972024-12-06T20:46:07.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1f3ac266-d332-425c-9303-b5b79879be98 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13982024-12-06T20:46:07.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1f3ac266-d332-425c-9303-b5b79879be98 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
13992024-12-06T20:46:08.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4baa1ab2-1d52-4515-aab6-619723b647d7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14002024-12-06T20:46:08.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4baa1ab2-1d52-4515-aab6-619723b647d7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14012024-12-06T20:46:08.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4baa1ab2-1d52-4515-aab6-619723b647d7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14022024-12-06T20:46:08.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
14032024-12-06T20:46:08.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
14042024-12-06T20:46:08.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14052024-12-06T20:46:08.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14062024-12-06T20:46:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14072024-12-06T20:46:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14082024-12-06T20:46:08.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14092024-12-06T20:46:08.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14102024-12-06T20:46:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14112024-12-06T20:46:08.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14122024-12-06T20:46:08.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14132024-12-06T20:46:08.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14142024-12-06T20:46:08.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14152024-12-06T20:46:08.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14162024-12-06T20:46:08.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14172024-12-06T20:46:08.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
14182024-12-06T20:46:08.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14192024-12-06T20:46:08.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14202024-12-06T20:46:08.882ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
14212024-12-06T20:46:08.882ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.416971ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
14222024-12-06T20:46:08.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.402085ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14232024-12-06T20:46:09.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81f887d2-e7a2-4ac5-b3d1-437e563f9c34 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14242024-12-06T20:46:09.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81f887d2-e7a2-4ac5-b3d1-437e563f9c34 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14252024-12-06T20:46:09.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81f887d2-e7a2-4ac5-b3d1-437e563f9c34 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14262024-12-06T20:46:10.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c99efa6c-d45e-49b7-a927-802d03d82176 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14272024-12-06T20:46:10.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c99efa6c-d45e-49b7-a927-802d03d82176 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14282024-12-06T20:46:10.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c99efa6c-d45e-49b7-a927-802d03d82176 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14292024-12-06T20:46:11.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 09fd96cb-0583-4702-a045-7a41c789c7d8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14302024-12-06T20:46:11.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 09fd96cb-0583-4702-a045-7a41c789c7d8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14312024-12-06T20:46:11.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 09fd96cb-0583-4702-a045-7a41c789c7d8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14322024-12-06T20:46:12.416ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 484 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = aa03ceb5-5229-4b8f-a151-3b73b9298dec response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
14332024-12-06T20:46:12.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 93a29c3d-741f-4b97-99e7-7374be4a1900 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14342024-12-06T20:46:12.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 93a29c3d-741f-4b97-99e7-7374be4a1900 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14352024-12-06T20:46:12.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 93a29c3d-741f-4b97-99e7-7374be4a1900 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14362024-12-06T20:46:13.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bb45db08-e624-4b5b-ba6a-6c6c39222d03 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14372024-12-06T20:46:13.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bb45db08-e624-4b5b-ba6a-6c6c39222d03 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14382024-12-06T20:46:13.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bb45db08-e624-4b5b-ba6a-6c6c39222d03 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14392024-12-06T20:46:14.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a58e3ea1-e070-479a-9889-929f27cb4789 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14402024-12-06T20:46:14.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a58e3ea1-e070-479a-9889-929f27cb4789 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14412024-12-06T20:46:14.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a58e3ea1-e070-479a-9889-929f27cb4789 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14422024-12-06T20:46:15.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e183411-d475-4b66-8877-2969acd8c95a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14432024-12-06T20:46:15.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e183411-d475-4b66-8877-2969acd8c95a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14442024-12-06T20:46:15.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e183411-d475-4b66-8877-2969acd8c95a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14452024-12-06T20:46:16.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7a11c1eb-fa33-471d-9535-fbd4be02f9b2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14462024-12-06T20:46:16.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7a11c1eb-fa33-471d-9535-fbd4be02f9b2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14472024-12-06T20:46:16.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7a11c1eb-fa33-471d-9535-fbd4be02f9b2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14482024-12-06T20:46:17.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0068d302-873f-4a62-bda3-9b00a4e823de roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14492024-12-06T20:46:17.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0068d302-873f-4a62-bda3-9b00a4e823de resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14502024-12-06T20:46:17.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0068d302-873f-4a62-bda3-9b00a4e823de response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14512024-12-06T20:46:18.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 225368f3-bef8-446f-8e46-084b10faf471 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14522024-12-06T20:46:18.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 225368f3-bef8-446f-8e46-084b10faf471 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14532024-12-06T20:46:18.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 225368f3-bef8-446f-8e46-084b10faf471 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14542024-12-06T20:46:18.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
14552024-12-06T20:46:18.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
14562024-12-06T20:46:18.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14572024-12-06T20:46:18.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14582024-12-06T20:46:18.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14592024-12-06T20:46:18.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14602024-12-06T20:46:18.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14612024-12-06T20:46:18.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14622024-12-06T20:46:18.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14632024-12-06T20:46:18.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.86826ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14642024-12-06T20:46:18.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14652024-12-06T20:46:18.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14662024-12-06T20:46:18.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14672024-12-06T20:46:18.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14682024-12-06T20:46:18.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14692024-12-06T20:46:18.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702024-12-06T20:46:18.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
14712024-12-06T20:46:18.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14722024-12-06T20:46:18.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14732024-12-06T20:46:18.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
14742024-12-06T20:46:18.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.90519ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
14752024-12-06T20:46:19.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b886fc2c-73e8-4572-a6cc-f14ccff4b643 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14762024-12-06T20:46:19.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b886fc2c-73e8-4572-a6cc-f14ccff4b643 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14772024-12-06T20:46:19.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b886fc2c-73e8-4572-a6cc-f14ccff4b643 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14782024-12-06T20:46:20.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c74f351b-8060-45eb-9731-db7726c9742e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14792024-12-06T20:46:20.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c74f351b-8060-45eb-9731-db7726c9742e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14802024-12-06T20:46:20.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c74f351b-8060-45eb-9731-db7726c9742e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14812024-12-06T20:46:21.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = af5635ad-2ad4-41d9-9577-df41d46fc6dd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14822024-12-06T20:46:21.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = af5635ad-2ad4-41d9-9577-df41d46fc6dd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14832024-12-06T20:46:21.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = af5635ad-2ad4-41d9-9577-df41d46fc6dd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14842024-12-06T20:46:22.417ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 594 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = ec315b35-d788-4a35-8385-9221ab7242e8 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
14852024-12-06T20:46:22.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2b4c31e3-1a54-4651-b536-5f24b5da4d99 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14862024-12-06T20:46:22.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2b4c31e3-1a54-4651-b536-5f24b5da4d99 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14872024-12-06T20:46:22.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2b4c31e3-1a54-4651-b536-5f24b5da4d99 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14882024-12-06T20:46:23.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4a47faea-85a1-4973-a631-a14341c4ef5c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14892024-12-06T20:46:23.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4a47faea-85a1-4973-a631-a14341c4ef5c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14902024-12-06T20:46:23.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4a47faea-85a1-4973-a631-a14341c4ef5c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14912024-12-06T20:46:24.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9524d4d0-914a-4338-a873-21491a07a0d1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14922024-12-06T20:46:24.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9524d4d0-914a-4338-a873-21491a07a0d1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14932024-12-06T20:46:24.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9524d4d0-914a-4338-a873-21491a07a0d1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14942024-12-06T20:46:25.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f3512bef-850f-4cad-b40e-200527e50e8e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14952024-12-06T20:46:25.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f3512bef-850f-4cad-b40e-200527e50e8e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14962024-12-06T20:46:25.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f3512bef-850f-4cad-b40e-200527e50e8e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14972024-12-06T20:46:26.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 37304a49-2273-44bb-86bb-336d7b491f4a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14982024-12-06T20:46:26.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 37304a49-2273-44bb-86bb-336d7b491f4a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
14992024-12-06T20:46:26.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 37304a49-2273-44bb-86bb-336d7b491f4a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
15002024-12-06T20:46:27.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 955eb265-166c-4747-ba47-5c991f3ad95f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
15012024-12-06T20:46:27.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 955eb265-166c-4747-ba47-5c991f3ad95f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
15022024-12-06T20:46:27.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 955eb265-166c-4747-ba47-5c991f3ad95f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
15032024-12-06T20:46:28.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8cccd84f-354e-4417-aae1-d759a73857a9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
15042024-12-06T20:46:28.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8cccd84f-354e-4417-aae1-d759a73857a9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
15052024-12-06T20:46:28.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8cccd84f-354e-4417-aae1-d759a73857a9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
15062024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
15072024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
15082024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15092024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
15102024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
15112024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15122024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15132024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
15142024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
15152024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
15162024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15172024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
15182024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
15192024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
15202024-12-06T20:46:28.855ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:36:28.855343110 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
15212024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
15222024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
15232024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15242024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15252024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15262024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
15272024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15282024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
15292024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
15302024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15312024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
15322024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15332024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15342024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
15352024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
15362024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15372024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
15382024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
15392024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
15402024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
15412024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15422024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15432024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
15442024-12-06T20:46:28.855ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
15452024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15462024-12-06T20:46:28.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6319, tv_nsec: 192924846 } })
15472024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
15482024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
15492024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15502024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
15512024-12-06T20:46:28.856ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
15522024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
15532024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.061\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
15542024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
15552024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15562024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
15572024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15582024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15592024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
15602024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15612024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
15622024-12-06T20:46:28.856ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
15632024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15642024-12-06T20:46:28.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6319, tv_nsec: 193152432 } })
15652024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15662024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
15672024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15682024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15692024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15702024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
15712024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
15722024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15732024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15742024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15752024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
15762024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
15772024-12-06T20:46:28.856ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15782024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15792024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15802024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15812024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15822024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15832024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15842024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15852024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15862024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15872024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15882024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15892024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15902024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15912024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15922024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15932024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15942024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
15952024-12-06T20:46:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.601102ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
15962024-12-06T20:46:28.857ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
15972024-12-06T20:46:28.857ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.655763ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
15982024-12-06T20:46:28.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15992024-12-06T20:46:28.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16002024-12-06T20:46:28.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16012024-12-06T20:46:28.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16022024-12-06T20:46:28.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16032024-12-06T20:46:28.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16042024-12-06T20:46:28.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16052024-12-06T20:46:28.860ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:36:28.855343110 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
16062024-12-06T20:46:28.860ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.089401ms iteration = 3 status = {"expiration":"2024-12-06T20:36:28.855343110Z","pruned":[]}
16072024-12-06T20:46:28.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16082024-12-06T20:46:28.862ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6319, tv_nsec: 199402473 } })
16092024-12-06T20:46:28.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16102024-12-06T20:46:28.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
16112024-12-06T20:46:28.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.00692ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
16122024-12-06T20:46:28.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16132024-12-06T20:46:28.863ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.012766ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16142024-12-06T20:46:28.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16152024-12-06T20:46:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16162024-12-06T20:46:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16172024-12-06T20:46:28.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16182024-12-06T20:46:28.864ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.599302ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
16192024-12-06T20:46:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16202024-12-06T20:46:28.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16212024-12-06T20:46:28.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16222024-12-06T20:46:28.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16232024-12-06T20:46:28.865ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16242024-12-06T20:46:28.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16252024-12-06T20:46:28.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16262024-12-06T20:46:28.867ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
16272024-12-06T20:46:28.867ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
16282024-12-06T20:46:28.867ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.907307ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
16292024-12-06T20:46:28.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16302024-12-06T20:46:28.868ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16312024-12-06T20:46:28.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6319, tv_nsec: 205756797 } })
16322024-12-06T20:46:28.869ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
16332024-12-06T20:46:28.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16342024-12-06T20:46:28.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16352024-12-06T20:46:28.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16362024-12-06T20:46:28.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
16372024-12-06T20:46:28.870ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16382024-12-06T20:46:28.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
16392024-12-06T20:46:28.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16402024-12-06T20:46:28.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16412024-12-06T20:46:28.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16422024-12-06T20:46:28.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16432024-12-06T20:46:28.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16442024-12-06T20:46:28.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16452024-12-06T20:46:28.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16462024-12-06T20:46:28.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16472024-12-06T20:46:28.876ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16482024-12-06T20:46:28.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16492024-12-06T20:46:28.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16502024-12-06T20:46:28.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.975297ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16512024-12-06T20:46:28.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16522024-12-06T20:46:28.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16532024-12-06T20:46:28.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16542024-12-06T20:46:28.879ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
16552024-12-06T20:46:28.879ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
16562024-12-06T20:46:28.879ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
16572024-12-06T20:46:28.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16582024-12-06T20:46:28.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16592024-12-06T20:46:28.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16602024-12-06T20:46:28.879ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16612024-12-06T20:46:28.879ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16622024-12-06T20:46:28.879ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16632024-12-06T20:46:28.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16642024-12-06T20:46:28.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16652024-12-06T20:46:28.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16662024-12-06T20:46:28.887ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16672024-12-06T20:46:28.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16682024-12-06T20:46:28.889ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6319, tv_nsec: 226400709 } })
16692024-12-06T20:46:28.889ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
16702024-12-06T20:46:28.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16712024-12-06T20:46:28.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16722024-12-06T20:46:28.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16732024-12-06T20:46:28.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 40.147255ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16742024-12-06T20:46:28.896ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16752024-12-06T20:46:28.896ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16762024-12-06T20:46:28.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16772024-12-06T20:46:28.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16782024-12-06T20:46:28.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16792024-12-06T20:46:28.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16802024-12-06T20:46:28.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16812024-12-06T20:46:28.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16822024-12-06T20:46:28.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16832024-12-06T20:46:28.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16842024-12-06T20:46:28.902ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16852024-12-06T20:46:28.902ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16862024-12-06T20:46:28.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16872024-12-06T20:46:28.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16882024-12-06T20:46:28.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16892024-12-06T20:46:28.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16902024-12-06T20:46:28.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16912024-12-06T20:46:28.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16922024-12-06T20:46:28.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16932024-12-06T20:46:28.950ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 94.224019ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
16942024-12-06T20:46:28.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16952024-12-06T20:46:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16962024-12-06T20:46:28.957ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16972024-12-06T20:46:28.957ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 101.334162ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16982024-12-06T20:46:28.957ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16992024-12-06T20:46:28.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17002024-12-06T20:46:28.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17012024-12-06T20:46:28.963ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17022024-12-06T20:46:28.963ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17032024-12-06T20:46:28.963ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.353637ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17042024-12-06T20:46:28.963ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17052024-12-06T20:46:28.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17062024-12-06T20:46:28.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17072024-12-06T20:46:28.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17082024-12-06T20:46:28.965ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
17092024-12-06T20:46:28.965ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
17102024-12-06T20:46:28.965ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
17112024-12-06T20:46:28.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17122024-12-06T20:46:28.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17132024-12-06T20:46:28.966ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
17142024-12-06T20:46:28.966ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
17152024-12-06T20:46:28.966ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 110.493458ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
17162024-12-06T20:46:28.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
17172024-12-06T20:46:28.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17182024-12-06T20:46:28.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17192024-12-06T20:46:28.969ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17202024-12-06T20:46:28.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17212024-12-06T20:46:28.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17222024-12-06T20:46:28.970ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
17232024-12-06T20:46:28.970ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
17242024-12-06T20:46:28.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17252024-12-06T20:46:28.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17262024-12-06T20:46:28.971ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 115.086297ms iteration = 5 status = 0
17272024-12-06T20:46:28.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17282024-12-06T20:46:28.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17292024-12-06T20:46:28.972ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17302024-12-06T20:46:28.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17312024-12-06T20:46:28.972ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 116.942925ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
17322024-12-06T20:46:28.972ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17332024-12-06T20:46:28.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17342024-12-06T20:46:28.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17352024-12-06T20:46:28.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17362024-12-06T20:46:28.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17372024-12-06T20:46:28.975ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17382024-12-06T20:46:28.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17392024-12-06T20:46:28.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17402024-12-06T20:46:28.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17412024-12-06T20:46:28.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
17422024-12-06T20:46:28.977ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17432024-12-06T20:46:28.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17442024-12-06T20:46:28.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17452024-12-06T20:46:28.978ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17462024-12-06T20:46:28.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17472024-12-06T20:46:28.979ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
17482024-12-06T20:46:28.980ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17492024-12-06T20:46:28.980ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
17502024-12-06T20:46:28.980ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 124.762246ms iteration = 3 status = {"generation":2}
17512024-12-06T20:46:28.994ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
17522024-12-06T20:46:28.994ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 138.452689ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
17532024-12-06T20:46:28.995ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17542024-12-06T20:46:28.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17552024-12-06T20:46:29.004ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.341034ms iteration = 7 status = {"physical_disks_added":0}
17562024-12-06T20:46:29.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 157.672635ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
17572024-12-06T20:46:29.023ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17582024-12-06T20:46:29.023ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17592024-12-06T20:46:29.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17602024-12-06T20:46:29.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17612024-12-06T20:46:29.045ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
17622024-12-06T20:46:29.045ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 190.116931ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17632024-12-06T20:46:29.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17642024-12-06T20:46:29.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17652024-12-06T20:46:29.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17662024-12-06T20:46:29.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17672024-12-06T20:46:29.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17682024-12-06T20:46:29.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17692024-12-06T20:46:29.102ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
17702024-12-06T20:46:29.102ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17712024-12-06T20:46:29.103ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d54e3bf9-d4b5-4d58-98cf-0451934efcc6", "content-length": "26", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
17722024-12-06T20:46:29.103ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17732024-12-06T20:46:29.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17742024-12-06T20:46:29.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17752024-12-06T20:46:29.105ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
17762024-12-06T20:46:29.109ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
17772024-12-06T20:46:29.109ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 253.333461ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
17782024-12-06T20:46:29.146ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
17792024-12-06T20:46:29.147ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
17802024-12-06T20:46:29.147ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17812024-12-06T20:46:29.147ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e377d5be-8dff-40a8-83d9-d833f88f9b1a", "content-length": "26", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
17822024-12-06T20:46:29.147ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17832024-12-06T20:46:29.149ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17842024-12-06T20:46:29.164ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
17852024-12-06T20:46:29.213ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17862024-12-06T20:46:29.213ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17872024-12-06T20:46:29.213ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fc45ccf-5fb4-4814-a527-141a45b83753", "content-length": "372", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
17882024-12-06T20:46:29.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17892024-12-06T20:46:29.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17902024-12-06T20:46:29.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17912024-12-06T20:46:29.215ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17922024-12-06T20:46:29.215ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17932024-12-06T20:46:29.215ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
17942024-12-06T20:46:29.215ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 360.619397ms iteration = 3 status = {"generation":1}
17952024-12-06T20:46:29.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17962024-12-06T20:46:29.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17972024-12-06T20:46:29.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17982024-12-06T20:46:29.219ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17992024-12-06T20:46:29.220ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18002024-12-06T20:46:29.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18012024-12-06T20:46:29.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18022024-12-06T20:46:29.229ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
18032024-12-06T20:46:29.229ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18042024-12-06T20:46:29.229ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "99a4ccc9-96a0-4e86-b6b0-8c3ee847d5da", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
18052024-12-06T20:46:29.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18062024-12-06T20:46:29.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18072024-12-06T20:46:29.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18082024-12-06T20:46:29.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18092024-12-06T20:46:29.234ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
18102024-12-06T20:46:29.234ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18112024-12-06T20:46:29.234ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed1c3eb1-4c0d-4a41-add4-ab2d35590f21", "content-length": "26", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
18122024-12-06T20:46:29.234ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18132024-12-06T20:46:29.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18142024-12-06T20:46:29.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18152024-12-06T20:46:29.235ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18162024-12-06T20:46:29.238ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18172024-12-06T20:46:29.238ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18182024-12-06T20:46:29.240ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "643fe4e8-3ae5-4ea9-a6ac-e5d3908cbd41", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
18192024-12-06T20:46:29.241ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 385.58012ms iteration = 5 status = {}
18202024-12-06T20:46:29.308ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
18212024-12-06T20:46:29.308ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8e82211b-4f58-4b09-90b1-1927a89f48d2", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
18222024-12-06T20:46:29.308ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
18232024-12-06T20:46:29.310ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8f31795a-efb4-4d7d-a331-dd40c1c0a786", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
18242024-12-06T20:46:29.311ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
18252024-12-06T20:46:29.312ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
18262024-12-06T20:46:29.312ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 457.051103ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
18272024-12-06T20:46:29.334ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 478.747532ms iteration = 5 status = {}
18282024-12-06T20:46:29.397ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18292024-12-06T20:46:29.397ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a6f4e1d-f9e3-45d4-a347-84757c1d3e69", "content-length": "691", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
18302024-12-06T20:46:29.397ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18312024-12-06T20:46:29.397ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18322024-12-06T20:46:29.397ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18332024-12-06T20:46:29.399ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 543.42229ms iteration = 5 status = {}
18342024-12-06T20:46:29.402ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18352024-12-06T20:46:29.402ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a5c0a24-e2c1-4c93-a85c-01366911795b", "content-length": "1", "date": "Fri, 06 Dec 2024 20:46:28 GMT"} })
18362024-12-06T20:46:29.404ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18372024-12-06T20:46:29.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18382024-12-06T20:46:29.407ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 552.099834ms iteration = 5 status = null
18392024-12-06T20:46:29.434ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
18402024-12-06T20:46:29.572ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
18412024-12-06T20:46:29.573ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "cfd299bd-97c1-4652-b59e-c7876e2567de", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18422024-12-06T20:46:29.573ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18432024-12-06T20:46:29.574ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2a2270e0-8955-41da-b8f5-faea83278fec", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18442024-12-06T20:46:29.574ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18452024-12-06T20:46:29.576ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2b49b861-8972-4436-8099-6f7be4d34205", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18462024-12-06T20:46:29.576ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18472024-12-06T20:46:29.578ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18482024-12-06T20:46:29.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 723.163153ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
18492024-12-06T20:46:29.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18502024-12-06T20:46:29.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18512024-12-06T20:46:29.595ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
18522024-12-06T20:46:29.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18532024-12-06T20:46:29.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18542024-12-06T20:46:29.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18552024-12-06T20:46:29.696ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4078295a-2eef-473f-a6a3-eea43a7424fe", "content-length": "134", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
18562024-12-06T20:46:29.696ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18572024-12-06T20:46:29.696ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
18582024-12-06T20:46:29.696ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18592024-12-06T20:46:29.696ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18602024-12-06T20:46:29.696ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18612024-12-06T20:46:29.696ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18622024-12-06T20:46:29.696ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18632024-12-06T20:46:29.696ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18642024-12-06T20:46:29.697ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18652024-12-06T20:46:29.697ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18662024-12-06T20:46:29.697ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
18672024-12-06T20:46:29.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18682024-12-06T20:46:29.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18692024-12-06T20:46:29.699ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18702024-12-06T20:46:29.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "299c8cc1-fcb8-489e-938f-5ebdae94eaa1", "content-length": "2", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
18712024-12-06T20:46:29.699ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18722024-12-06T20:46:29.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2d24fac-4545-416f-9d38-79ae13d5a9f4", "content-length": "52", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
18732024-12-06T20:46:29.699ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
18742024-12-06T20:46:29.699ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18752024-12-06T20:46:29.795ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "388ae6b4-ef2c-44d6-9573-d9b27fe091e4", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
18762024-12-06T20:46:29.795ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
18772024-12-06T20:46:29.795ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18782024-12-06T20:46:29.796ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d894b09b-fa9a-47df-a313-2bac32cc136c", "content-length": "682", "date": "Fri, 06 Dec 2024 20:46:29 GMT"} })
18792024-12-06T20:46:29.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18802024-12-06T20:46:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18812024-12-06T20:46:29.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18822024-12-06T20:46:29.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18832024-12-06T20:46:29.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18842024-12-06T20:46:29.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18852024-12-06T20:46:29.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18862024-12-06T20:46:29.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18872024-12-06T20:46:29.810ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 954.763703ms iteration = 5 status = {}
18882024-12-06T20:46:29.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 83853623-ba7e-40de-ae76-cdc2f8d911d0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
18892024-12-06T20:46:29.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 83853623-ba7e-40de-ae76-cdc2f8d911d0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
18902024-12-06T20:46:29.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 83853623-ba7e-40de-ae76-cdc2f8d911d0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
18912024-12-06T20:46:30.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0528c6b8-1690-4707-a7c7-9883afa27c02 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
18922024-12-06T20:46:30.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0528c6b8-1690-4707-a7c7-9883afa27c02 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
18932024-12-06T20:46:30.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0528c6b8-1690-4707-a7c7-9883afa27c02 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
18942024-12-06T20:46:31.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d042312-38c8-4b94-9283-55169ebf6744 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
18952024-12-06T20:46:31.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d042312-38c8-4b94-9283-55169ebf6744 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
18962024-12-06T20:46:31.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d042312-38c8-4b94-9283-55169ebf6744 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
18972024-12-06T20:46:32.416ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 441 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 5aafc709-2e5c-4824-b65a-71eb78eafe17 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
18982024-12-06T20:46:32.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb9a2da2-1f1f-450b-b394-62a3909f074b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
18992024-12-06T20:46:32.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb9a2da2-1f1f-450b-b394-62a3909f074b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19002024-12-06T20:46:32.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb9a2da2-1f1f-450b-b394-62a3909f074b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19012024-12-06T20:46:33.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad8cc8ca-bfa6-4d09-a8f4-5c1a91af36e8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19022024-12-06T20:46:33.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad8cc8ca-bfa6-4d09-a8f4-5c1a91af36e8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19032024-12-06T20:46:33.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad8cc8ca-bfa6-4d09-a8f4-5c1a91af36e8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19042024-12-06T20:46:34.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f555e5ec-766d-4d7f-bcb1-60e846ea4803 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19052024-12-06T20:46:34.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f555e5ec-766d-4d7f-bcb1-60e846ea4803 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19062024-12-06T20:46:34.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f555e5ec-766d-4d7f-bcb1-60e846ea4803 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19072024-12-06T20:46:35.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 679f1a63-254d-4a83-a8ec-94516ff17ab1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19082024-12-06T20:46:35.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 679f1a63-254d-4a83-a8ec-94516ff17ab1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19092024-12-06T20:46:35.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 679f1a63-254d-4a83-a8ec-94516ff17ab1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19102024-12-06T20:46:36.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c59a6f73-466e-415c-838c-83330d94a1a2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19112024-12-06T20:46:36.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c59a6f73-466e-415c-838c-83330d94a1a2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19122024-12-06T20:46:36.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c59a6f73-466e-415c-838c-83330d94a1a2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19132024-12-06T20:46:37.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d315ae93-3cb4-4796-b4f3-7c6f50824341 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19142024-12-06T20:46:37.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d315ae93-3cb4-4796-b4f3-7c6f50824341 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19152024-12-06T20:46:37.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d315ae93-3cb4-4796-b4f3-7c6f50824341 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19162024-12-06T20:46:38.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
19172024-12-06T20:46:38.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
19182024-12-06T20:46:38.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19192024-12-06T20:46:38.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19202024-12-06T20:46:38.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19212024-12-06T20:46:38.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19222024-12-06T20:46:38.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19232024-12-06T20:46:38.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19242024-12-06T20:46:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19252024-12-06T20:46:38.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.006833ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19262024-12-06T20:46:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19272024-12-06T20:46:38.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19282024-12-06T20:46:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19292024-12-06T20:46:38.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19302024-12-06T20:46:38.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19312024-12-06T20:46:38.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19322024-12-06T20:46:38.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
19332024-12-06T20:46:38.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19342024-12-06T20:46:38.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19352024-12-06T20:46:38.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
19362024-12-06T20:46:38.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.506032ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
19372024-12-06T20:46:39.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e5d6f93a-eb87-46c9-9c99-0ac6a66c6407 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19382024-12-06T20:46:39.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e5d6f93a-eb87-46c9-9c99-0ac6a66c6407 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19392024-12-06T20:46:39.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e5d6f93a-eb87-46c9-9c99-0ac6a66c6407 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19402024-12-06T20:46:40.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 47cf5360-4ec9-4a7c-b85e-835ec87b5545 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19412024-12-06T20:46:40.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 47cf5360-4ec9-4a7c-b85e-835ec87b5545 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19422024-12-06T20:46:40.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 47cf5360-4ec9-4a7c-b85e-835ec87b5545 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19432024-12-06T20:46:41.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a173d0ed-a248-4ebe-8c1d-6a6a9d6f8bd8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19442024-12-06T20:46:41.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a173d0ed-a248-4ebe-8c1d-6a6a9d6f8bd8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19452024-12-06T20:46:41.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a173d0ed-a248-4ebe-8c1d-6a6a9d6f8bd8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19462024-12-06T20:46:42.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f6e43ae6-a456-411c-9d0e-2d4c6a963645 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19472024-12-06T20:46:42.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f6e43ae6-a456-411c-9d0e-2d4c6a963645 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19482024-12-06T20:46:42.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f6e43ae6-a456-411c-9d0e-2d4c6a963645 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19492024-12-06T20:46:42.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = b12febd7-c39e-4dcf-9291-9f2e21fd52cf roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
19502024-12-06T20:46:42.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = b12febd7-c39e-4dcf-9291-9f2e21fd52cf resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
19512024-12-06T20:46:42.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = b12febd7-c39e-4dcf-9291-9f2e21fd52cf response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
19522024-12-06T20:46:42.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = d87e45f9-fc4a-4cde-b86a-ee76081a42d4 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
19532024-12-06T20:46:42.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = d87e45f9-fc4a-4cde-b86a-ee76081a42d4 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
19542024-12-06T20:46:42.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = d87e45f9-fc4a-4cde-b86a-ee76081a42d4 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
19552024-12-06T20:46:42.416ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 3e650629-7556-4e35-afe7-da4794b27969 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
19562024-12-06T20:46:43.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 80005786-291c-4609-96ef-20aaae3cbd2e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19572024-12-06T20:46:43.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 80005786-291c-4609-96ef-20aaae3cbd2e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19582024-12-06T20:46:43.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 80005786-291c-4609-96ef-20aaae3cbd2e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19592024-12-06T20:46:44.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 335aa9e4-4c44-4564-96ef-8bbd83e4d59c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19602024-12-06T20:46:44.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 335aa9e4-4c44-4564-96ef-8bbd83e4d59c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19612024-12-06T20:46:44.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 335aa9e4-4c44-4564-96ef-8bbd83e4d59c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19622024-12-06T20:46:45.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 98dd05df-4ce5-4748-a9e5-30b9d05728a5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19632024-12-06T20:46:45.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 98dd05df-4ce5-4748-a9e5-30b9d05728a5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19642024-12-06T20:46:45.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 98dd05df-4ce5-4748-a9e5-30b9d05728a5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19652024-12-06T20:46:46.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d9b0872-8ee2-408c-baf9-03f2372eb8ae roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19662024-12-06T20:46:46.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d9b0872-8ee2-408c-baf9-03f2372eb8ae resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19672024-12-06T20:46:46.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d9b0872-8ee2-408c-baf9-03f2372eb8ae response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19682024-12-06T20:46:47.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3aeccbca-1cd4-4f93-8600-94871fdb127e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19692024-12-06T20:46:47.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3aeccbca-1cd4-4f93-8600-94871fdb127e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19702024-12-06T20:46:47.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3aeccbca-1cd4-4f93-8600-94871fdb127e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19712024-12-06T20:46:48.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 59e8c235-ed98-45cd-8dd3-3418cc67950f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19722024-12-06T20:46:48.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 59e8c235-ed98-45cd-8dd3-3418cc67950f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19732024-12-06T20:46:48.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 59e8c235-ed98-45cd-8dd3-3418cc67950f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19742024-12-06T20:46:48.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
19752024-12-06T20:46:48.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
19762024-12-06T20:46:48.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19772024-12-06T20:46:48.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19782024-12-06T20:46:48.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19792024-12-06T20:46:48.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19802024-12-06T20:46:48.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19812024-12-06T20:46:48.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19822024-12-06T20:46:48.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19832024-12-06T20:46:48.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.944081ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19842024-12-06T20:46:48.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19852024-12-06T20:46:48.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19862024-12-06T20:46:48.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19872024-12-06T20:46:48.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19882024-12-06T20:46:48.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19892024-12-06T20:46:48.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19902024-12-06T20:46:48.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
19912024-12-06T20:46:48.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19922024-12-06T20:46:48.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19932024-12-06T20:46:48.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
19942024-12-06T20:46:48.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.352035ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
19952024-12-06T20:46:49.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 877262fc-0133-42b3-a5d1-333d9e9d6067 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19962024-12-06T20:46:49.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 877262fc-0133-42b3-a5d1-333d9e9d6067 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19972024-12-06T20:46:49.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 877262fc-0133-42b3-a5d1-333d9e9d6067 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19982024-12-06T20:46:50.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 801145c9-8f1e-467a-917a-685ac07d36ed roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
19992024-12-06T20:46:50.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 801145c9-8f1e-467a-917a-685ac07d36ed resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20002024-12-06T20:46:50.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 801145c9-8f1e-467a-917a-685ac07d36ed response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20012024-12-06T20:46:51.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0d96cfa6-e963-4235-8d12-ee8494827b8f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20022024-12-06T20:46:51.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0d96cfa6-e963-4235-8d12-ee8494827b8f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20032024-12-06T20:46:51.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0d96cfa6-e963-4235-8d12-ee8494827b8f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20042024-12-06T20:46:52.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 587da9a9-97e4-4138-b2db-c1d552dbeb67 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20052024-12-06T20:46:52.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 587da9a9-97e4-4138-b2db-c1d552dbeb67 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20062024-12-06T20:46:52.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 587da9a9-97e4-4138-b2db-c1d552dbeb67 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20072024-12-06T20:46:52.416ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 516 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = b099c322-d545-4f26-b4e8-f5d93a01ff3a response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
20082024-12-06T20:46:53.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dc238ef2-a07a-4696-b944-741459d88a95 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20092024-12-06T20:46:53.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dc238ef2-a07a-4696-b944-741459d88a95 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20102024-12-06T20:46:53.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dc238ef2-a07a-4696-b944-741459d88a95 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20112024-12-06T20:46:54.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = edea3cd6-899f-4cfd-9888-dd015f6f73d6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20122024-12-06T20:46:54.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = edea3cd6-899f-4cfd-9888-dd015f6f73d6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20132024-12-06T20:46:54.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = edea3cd6-899f-4cfd-9888-dd015f6f73d6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20142024-12-06T20:46:55.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 36185d26-efd4-4471-8e71-e3734ca09e98 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20152024-12-06T20:46:55.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 36185d26-efd4-4471-8e71-e3734ca09e98 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20162024-12-06T20:46:55.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 36185d26-efd4-4471-8e71-e3734ca09e98 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20172024-12-06T20:46:56.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ebaa9794-35e1-4344-a0b5-b0c2f8a906f0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20182024-12-06T20:46:56.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ebaa9794-35e1-4344-a0b5-b0c2f8a906f0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20192024-12-06T20:46:56.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ebaa9794-35e1-4344-a0b5-b0c2f8a906f0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20202024-12-06T20:46:57.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 84883305-13e5-484d-8e62-a3346fa22159 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20212024-12-06T20:46:57.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 84883305-13e5-484d-8e62-a3346fa22159 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20222024-12-06T20:46:57.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 84883305-13e5-484d-8e62-a3346fa22159 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20232024-12-06T20:46:58.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 48e70c19-2ebb-4bf9-8098-f3aad54b97f0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20242024-12-06T20:46:58.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 48e70c19-2ebb-4bf9-8098-f3aad54b97f0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20252024-12-06T20:46:58.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 48e70c19-2ebb-4bf9-8098-f3aad54b97f0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
20262024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
20272024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20282024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20292024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
20302024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20312024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
20322024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
20332024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20342024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20352024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
20362024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
20372024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20382024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
20392024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20402024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20412024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20422024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
20432024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
20442024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20452024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20462024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
20472024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20482024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
20492024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20502024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
20512024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20522024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
20532024-12-06T20:46:58.855ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20542024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20552024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
20562024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
20572024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20582024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
20592024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
20602024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20612024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20622024-12-06T20:46:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20632024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20642024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20652024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20662024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20672024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20682024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20692024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20702024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20712024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20722024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20732024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20742024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20752024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20762024-12-06T20:46:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20772024-12-06T20:46:58.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6349, tv_nsec: 195205284 } })
20782024-12-06T20:46:58.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20792024-12-06T20:46:58.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
20802024-12-06T20:46:58.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20812024-12-06T20:46:58.859ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20822024-12-06T20:46:58.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20832024-12-06T20:46:58.860ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.168947ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20842024-12-06T20:46:58.860ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20852024-12-06T20:46:58.860ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20862024-12-06T20:46:58.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20872024-12-06T20:46:58.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20882024-12-06T20:46:58.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20892024-12-06T20:46:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20902024-12-06T20:46:58.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20912024-12-06T20:46:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20922024-12-06T20:46:58.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20932024-12-06T20:46:58.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20942024-12-06T20:46:58.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20952024-12-06T20:46:58.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20962024-12-06T20:46:58.863ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20972024-12-06T20:46:58.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20982024-12-06T20:46:58.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20992024-12-06T20:46:58.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.001862ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
21002024-12-06T20:46:58.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21012024-12-06T20:46:58.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21022024-12-06T20:46:58.866ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6349, tv_nsec: 203853147 } })
21032024-12-06T20:46:58.867ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
21042024-12-06T20:46:58.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21052024-12-06T20:46:58.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21062024-12-06T20:46:58.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21072024-12-06T20:46:58.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21082024-12-06T20:46:58.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21092024-12-06T20:46:58.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21102024-12-06T20:46:58.869ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21112024-12-06T20:46:58.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21122024-12-06T20:46:58.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21132024-12-06T20:46:58.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21142024-12-06T20:46:58.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21152024-12-06T20:46:58.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 20.102738ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
21162024-12-06T20:46:58.878ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21172024-12-06T20:46:58.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21182024-12-06T20:46:58.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21192024-12-06T20:46:58.879ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21202024-12-06T20:46:58.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21212024-12-06T20:46:58.879ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21222024-12-06T20:46:58.879ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21232024-12-06T20:46:58.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21242024-12-06T20:46:58.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21252024-12-06T20:46:58.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21262024-12-06T20:46:58.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21272024-12-06T20:46:58.881ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21282024-12-06T20:46:58.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21292024-12-06T20:46:58.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21302024-12-06T20:46:58.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21312024-12-06T20:46:58.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 26.880083ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21322024-12-06T20:46:58.883ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6349, tv_nsec: 220581858 } })
21332024-12-06T20:46:58.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21342024-12-06T20:46:58.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21352024-12-06T20:46:58.883ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
21362024-12-06T20:46:58.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21372024-12-06T20:46:58.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21382024-12-06T20:46:58.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21392024-12-06T20:46:58.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 31.239195ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
21402024-12-06T20:46:58.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21412024-12-06T20:46:58.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21422024-12-06T20:46:58.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21432024-12-06T20:46:58.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
21442024-12-06T20:46:58.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21452024-12-06T20:46:58.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21462024-12-06T20:46:58.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21472024-12-06T20:46:58.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21482024-12-06T20:46:58.906ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21492024-12-06T20:46:58.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21502024-12-06T20:46:58.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21512024-12-06T20:46:58.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21522024-12-06T20:46:58.909ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
21532024-12-06T20:46:58.909ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.740846ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
21542024-12-06T20:46:58.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.566589ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21552024-12-06T20:46:58.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21562024-12-06T20:46:58.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21572024-12-06T20:46:58.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21582024-12-06T20:46:58.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21592024-12-06T20:46:58.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21602024-12-06T20:46:58.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21612024-12-06T20:46:58.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21622024-12-06T20:46:58.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21632024-12-06T20:46:58.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 70.014465ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21642024-12-06T20:46:58.926ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21652024-12-06T20:46:58.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21662024-12-06T20:46:58.929ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21672024-12-06T20:46:58.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21682024-12-06T20:46:58.932ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21692024-12-06T20:46:58.932ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21702024-12-06T20:46:58.933ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84665ee8-0897-4288-beb7-09ede3cc3c27", "content-length": "26", "date": "Fri, 06 Dec 2024 20:46:58 GMT"} })
21712024-12-06T20:46:58.933ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21722024-12-06T20:46:58.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21732024-12-06T20:46:58.934ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21742024-12-06T20:46:58.934ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21752024-12-06T20:46:58.934ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 78.323269ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21762024-12-06T20:46:58.934ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21772024-12-06T20:46:58.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
21782024-12-06T20:46:58.938ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21792024-12-06T20:46:58.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21802024-12-06T20:46:58.940ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21812024-12-06T20:46:58.940ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.589691ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21822024-12-06T20:46:58.941ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.270264ms iteration = 8 status = {"physical_disks_added":0}
21832024-12-06T20:46:59.048ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21842024-12-06T20:46:59.049ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0234a680-eb52-45b8-b99a-01d4322c9ebb", "content-length": "691", "date": "Fri, 06 Dec 2024 20:46:59 GMT"} })
21852024-12-06T20:46:59.049ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
21862024-12-06T20:46:59.049ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
21872024-12-06T20:46:59.049ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
21882024-12-06T20:46:59.049ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 194.123794ms iteration = 6 status = {}
21892024-12-06T20:46:59.050ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 194.925895ms iteration = 6 status = 0
21902024-12-06T20:46:59.055ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21912024-12-06T20:46:59.055ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "66321581-5371-494a-8d2a-002441a8691c", "content-length": "1", "date": "Fri, 06 Dec 2024 20:46:58 GMT"} })
21922024-12-06T20:46:59.056ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21932024-12-06T20:46:59.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21942024-12-06T20:46:59.058ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 203.690811ms iteration = 6 status = null
21952024-12-06T20:46:59.068ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21962024-12-06T20:46:59.068ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21972024-12-06T20:46:59.068ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1b4da2a-0b5b-42ac-abfa-ba110a6c0df7", "content-length": "26", "date": "Fri, 06 Dec 2024 20:46:58 GMT"} })
21982024-12-06T20:46:59.068ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21992024-12-06T20:46:59.070ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22002024-12-06T20:46:59.089ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
22012024-12-06T20:46:59.089ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22022024-12-06T20:46:59.089ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe67b3e5-b9ab-40fb-b840-adc289343fcd", "content-length": "26", "date": "Fri, 06 Dec 2024 20:46:58 GMT"} })
22032024-12-06T20:46:59.089ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22042024-12-06T20:46:59.091ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
22052024-12-06T20:46:59.104ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22062024-12-06T20:46:59.104ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22072024-12-06T20:46:59.105ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1711dca6-660b-4227-87b5-f98f30112288", "content-length": "372", "date": "Fri, 06 Dec 2024 20:46:59 GMT"} })
22082024-12-06T20:46:59.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22092024-12-06T20:46:59.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22102024-12-06T20:46:59.121ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
22112024-12-06T20:46:59.121ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22122024-12-06T20:46:59.121ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cfdd8271-0892-4793-bbfe-0fcd5e3f039f", "date": "Fri, 06 Dec 2024 20:46:59 GMT"} })
22132024-12-06T20:46:59.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22142024-12-06T20:46:59.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22152024-12-06T20:46:59.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22162024-12-06T20:46:59.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22172024-12-06T20:46:59.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22182024-12-06T20:46:59.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22192024-12-06T20:46:59.130ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22202024-12-06T20:46:59.130ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22212024-12-06T20:46:59.130ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7b72aa5f-5684-48c3-98f3-60250f63711b", "date": "Fri, 06 Dec 2024 20:46:59 GMT"} })
22222024-12-06T20:46:59.132ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 276.768086ms iteration = 6 status = {}
22232024-12-06T20:46:59.140ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 285.026048ms iteration = 6 status = {}
22242024-12-06T20:46:59.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22252024-12-06T20:46:59.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22262024-12-06T20:46:59.209ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
22272024-12-06T20:46:59.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22282024-12-06T20:46:59.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22292024-12-06T20:46:59.218ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22302024-12-06T20:46:59.218ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdd019aa-bc07-49a1-b870-61bea0b4408f", "content-length": "134", "date": "Fri, 06 Dec 2024 20:46:58 GMT"} })
22312024-12-06T20:46:59.218ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22322024-12-06T20:46:59.218ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
22332024-12-06T20:46:59.218ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22342024-12-06T20:46:59.218ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22352024-12-06T20:46:59.218ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22362024-12-06T20:46:59.218ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22372024-12-06T20:46:59.218ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22382024-12-06T20:46:59.218ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22392024-12-06T20:46:59.218ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22402024-12-06T20:46:59.218ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22412024-12-06T20:46:59.219ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
22422024-12-06T20:46:59.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22432024-12-06T20:46:59.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22442024-12-06T20:46:59.221ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22452024-12-06T20:46:59.221ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "96369ad8-c0df-4420-ac72-07a4e02efbee", "content-length": "2", "date": "Fri, 06 Dec 2024 20:46:58 GMT"} })
22462024-12-06T20:46:59.221ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22472024-12-06T20:46:59.221ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d02a2d53-67ac-4ffa-9bd0-1b4843558cf0", "content-length": "52", "date": "Fri, 06 Dec 2024 20:46:58 GMT"} })
22482024-12-06T20:46:59.221ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
22492024-12-06T20:46:59.221ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22502024-12-06T20:46:59.324ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "04ba7706-c58b-4659-b65e-fef49211c377", "date": "Fri, 06 Dec 2024 20:46:59 GMT"} })
22512024-12-06T20:46:59.324ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
22522024-12-06T20:46:59.324ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22532024-12-06T20:46:59.325ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c54b26ec-f148-4f82-a455-8bcafc0284f6", "content-length": "682", "date": "Fri, 06 Dec 2024 20:46:59 GMT"} })
22542024-12-06T20:46:59.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22552024-12-06T20:46:59.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22562024-12-06T20:46:59.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22572024-12-06T20:46:59.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22582024-12-06T20:46:59.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22592024-12-06T20:46:59.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22602024-12-06T20:46:59.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22612024-12-06T20:46:59.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22622024-12-06T20:46:59.339ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 483.724491ms iteration = 6 status = {}
22632024-12-06T20:46:59.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d414831b-ed03-43f0-89bd-a47a17bbee66 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22642024-12-06T20:46:59.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d414831b-ed03-43f0-89bd-a47a17bbee66 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22652024-12-06T20:46:59.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d414831b-ed03-43f0-89bd-a47a17bbee66 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22662024-12-06T20:47:00.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e2337d45-ea35-49e1-b4f4-62ae1f3afb00 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22672024-12-06T20:47:00.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e2337d45-ea35-49e1-b4f4-62ae1f3afb00 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22682024-12-06T20:47:00.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e2337d45-ea35-49e1-b4f4-62ae1f3afb00 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22692024-12-06T20:47:01.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 01bb1bff-001f-44a8-8f9d-b4b374e3c971 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22702024-12-06T20:47:01.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 01bb1bff-001f-44a8-8f9d-b4b374e3c971 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22712024-12-06T20:47:01.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 01bb1bff-001f-44a8-8f9d-b4b374e3c971 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22722024-12-06T20:47:02.416ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 527 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = a3538144-e06b-45ff-8f68-435e61e1c21b response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
22732024-12-06T20:47:02.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5830ffeb-4120-4d17-b13d-5cbec1ef6565 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22742024-12-06T20:47:02.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5830ffeb-4120-4d17-b13d-5cbec1ef6565 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22752024-12-06T20:47:02.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5830ffeb-4120-4d17-b13d-5cbec1ef6565 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22762024-12-06T20:47:03.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c2742b2e-6fe9-4ffd-b968-17fa8bee2f50 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22772024-12-06T20:47:03.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c2742b2e-6fe9-4ffd-b968-17fa8bee2f50 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22782024-12-06T20:47:03.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c2742b2e-6fe9-4ffd-b968-17fa8bee2f50 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22792024-12-06T20:47:04.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2c7ade54-a4da-41a0-b2c0-1109ccd42b02 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22802024-12-06T20:47:04.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2c7ade54-a4da-41a0-b2c0-1109ccd42b02 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22812024-12-06T20:47:04.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2c7ade54-a4da-41a0-b2c0-1109ccd42b02 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22822024-12-06T20:47:05.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ffa149ad-ee21-41d3-b894-ce3a0b1f2fbc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22832024-12-06T20:47:05.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ffa149ad-ee21-41d3-b894-ce3a0b1f2fbc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22842024-12-06T20:47:05.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ffa149ad-ee21-41d3-b894-ce3a0b1f2fbc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22852024-12-06T20:47:06.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 31e5ed9a-239b-48e2-a13c-7bdea39f66ff roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22862024-12-06T20:47:06.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 31e5ed9a-239b-48e2-a13c-7bdea39f66ff resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22872024-12-06T20:47:06.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 31e5ed9a-239b-48e2-a13c-7bdea39f66ff response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22882024-12-06T20:47:07.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e4cf3377-4bb1-4f3e-8f43-a79cd94cf9c9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22892024-12-06T20:47:07.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e4cf3377-4bb1-4f3e-8f43-a79cd94cf9c9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22902024-12-06T20:47:07.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e4cf3377-4bb1-4f3e-8f43-a79cd94cf9c9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22912024-12-06T20:47:08.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 68d86e79-cb07-4a14-9afd-4a330d1986bc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22922024-12-06T20:47:08.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 68d86e79-cb07-4a14-9afd-4a330d1986bc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22932024-12-06T20:47:08.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 68d86e79-cb07-4a14-9afd-4a330d1986bc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
22942024-12-06T20:47:08.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
22952024-12-06T20:47:08.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
22962024-12-06T20:47:08.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22972024-12-06T20:47:08.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22982024-12-06T20:47:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22992024-12-06T20:47:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23002024-12-06T20:47:08.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23012024-12-06T20:47:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23022024-12-06T20:47:08.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23032024-12-06T20:47:08.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.697766ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23042024-12-06T20:47:08.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23052024-12-06T20:47:08.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23062024-12-06T20:47:08.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23072024-12-06T20:47:08.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23082024-12-06T20:47:08.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23092024-12-06T20:47:08.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23102024-12-06T20:47:08.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
23112024-12-06T20:47:08.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23122024-12-06T20:47:08.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23132024-12-06T20:47:08.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
23142024-12-06T20:47:08.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.797131ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
23152024-12-06T20:47:09.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c3a709ea-2e63-41d9-aa3d-29c4e13bcb9b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23162024-12-06T20:47:09.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c3a709ea-2e63-41d9-aa3d-29c4e13bcb9b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23172024-12-06T20:47:09.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c3a709ea-2e63-41d9-aa3d-29c4e13bcb9b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23182024-12-06T20:47:10.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 028518a4-e31b-46d5-b8bf-e2a1deba442f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23192024-12-06T20:47:10.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 028518a4-e31b-46d5-b8bf-e2a1deba442f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23202024-12-06T20:47:10.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 028518a4-e31b-46d5-b8bf-e2a1deba442f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23212024-12-06T20:47:11.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4fb1bc53-319a-4cd3-b94a-af881346a828 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23222024-12-06T20:47:11.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4fb1bc53-319a-4cd3-b94a-af881346a828 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23232024-12-06T20:47:11.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4fb1bc53-319a-4cd3-b94a-af881346a828 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23242024-12-06T20:47:12.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = ef31a4c4-e51d-44b7-8522-c7ee083e1a9f roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
23252024-12-06T20:47:12.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = ef31a4c4-e51d-44b7-8522-c7ee083e1a9f resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
23262024-12-06T20:47:12.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 476 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 2e9763b6-3ddd-47ea-8d00-e89dcaf4bbc0 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
23272024-12-06T20:47:12.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = ef31a4c4-e51d-44b7-8522-c7ee083e1a9f response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
23282024-12-06T20:47:12.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 5704a810-af8b-41e0-a80c-65137a45ede9 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
23292024-12-06T20:47:12.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 5704a810-af8b-41e0-a80c-65137a45ede9 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
23302024-12-06T20:47:12.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 5704a810-af8b-41e0-a80c-65137a45ede9 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
23312024-12-06T20:47:12.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 82e0879c-bff1-4c91-8202-240e5712be39 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23322024-12-06T20:47:12.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 82e0879c-bff1-4c91-8202-240e5712be39 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23332024-12-06T20:47:12.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 82e0879c-bff1-4c91-8202-240e5712be39 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23342024-12-06T20:47:13.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1c65f8d7-461f-43eb-b875-c5f11b023229 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23352024-12-06T20:47:13.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1c65f8d7-461f-43eb-b875-c5f11b023229 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23362024-12-06T20:47:13.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1c65f8d7-461f-43eb-b875-c5f11b023229 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23372024-12-06T20:47:14.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 55810e90-e65f-4555-9009-dbe34e83e999 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23382024-12-06T20:47:14.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 55810e90-e65f-4555-9009-dbe34e83e999 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23392024-12-06T20:47:14.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 55810e90-e65f-4555-9009-dbe34e83e999 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23402024-12-06T20:47:15.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 819d26b7-3fbb-43d2-9432-3bfc70b1ea85 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23412024-12-06T20:47:15.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 819d26b7-3fbb-43d2-9432-3bfc70b1ea85 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23422024-12-06T20:47:15.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 819d26b7-3fbb-43d2-9432-3bfc70b1ea85 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23432024-12-06T20:47:16.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cbe08681-fd37-4197-8fb4-a8bc97eeec4d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23442024-12-06T20:47:16.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cbe08681-fd37-4197-8fb4-a8bc97eeec4d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23452024-12-06T20:47:16.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cbe08681-fd37-4197-8fb4-a8bc97eeec4d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23462024-12-06T20:47:17.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ef2220e3-9a01-48cb-8fcb-82dcc0abd747 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23472024-12-06T20:47:17.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ef2220e3-9a01-48cb-8fcb-82dcc0abd747 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23482024-12-06T20:47:17.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ef2220e3-9a01-48cb-8fcb-82dcc0abd747 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23492024-12-06T20:47:18.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
23502024-12-06T20:47:18.856ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
23512024-12-06T20:47:18.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23522024-12-06T20:47:18.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23532024-12-06T20:47:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23542024-12-06T20:47:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23552024-12-06T20:47:18.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23562024-12-06T20:47:18.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23572024-12-06T20:47:18.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23582024-12-06T20:47:18.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.26733ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23592024-12-06T20:47:18.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23602024-12-06T20:47:18.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23612024-12-06T20:47:18.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23622024-12-06T20:47:18.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23632024-12-06T20:47:18.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23642024-12-06T20:47:18.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23652024-12-06T20:47:18.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
23662024-12-06T20:47:18.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23672024-12-06T20:47:18.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23682024-12-06T20:47:18.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
23692024-12-06T20:47:18.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.864287ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
23702024-12-06T20:47:18.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3dabfb9e-9dbc-49b1-84fa-a120f9ad16c1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23712024-12-06T20:47:18.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3dabfb9e-9dbc-49b1-84fa-a120f9ad16c1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23722024-12-06T20:47:18.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3dabfb9e-9dbc-49b1-84fa-a120f9ad16c1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23732024-12-06T20:47:19.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 331ffbf4-3b02-445b-a081-a4fa0fba2b1e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23742024-12-06T20:47:19.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 331ffbf4-3b02-445b-a081-a4fa0fba2b1e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23752024-12-06T20:47:19.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 331ffbf4-3b02-445b-a081-a4fa0fba2b1e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23762024-12-06T20:47:20.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81a3ecc0-a51e-4b1c-9b1e-806a1f190759 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23772024-12-06T20:47:20.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81a3ecc0-a51e-4b1c-9b1e-806a1f190759 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23782024-12-06T20:47:20.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81a3ecc0-a51e-4b1c-9b1e-806a1f190759 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23792024-12-06T20:47:21.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 736eab5f-2bdb-478a-94ca-1c468bd698ea roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23802024-12-06T20:47:21.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 736eab5f-2bdb-478a-94ca-1c468bd698ea resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23812024-12-06T20:47:21.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 736eab5f-2bdb-478a-94ca-1c468bd698ea response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23822024-12-06T20:47:22.416ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 591 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = d86d123e-59d5-4818-95c2-2048bb7ff9d8 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
23832024-12-06T20:47:22.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9f2a34ac-4b2d-4c28-8674-0c0b57addc11 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23842024-12-06T20:47:22.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9f2a34ac-4b2d-4c28-8674-0c0b57addc11 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23852024-12-06T20:47:22.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9f2a34ac-4b2d-4c28-8674-0c0b57addc11 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23862024-12-06T20:47:24.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c9e5563b-aa37-4e84-8091-16f4a0ce65ae roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23872024-12-06T20:47:24.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c9e5563b-aa37-4e84-8091-16f4a0ce65ae resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23882024-12-06T20:47:24.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c9e5563b-aa37-4e84-8091-16f4a0ce65ae response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23892024-12-06T20:47:25.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e45c1d38-7409-41fb-b6cb-c8f594574772 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23902024-12-06T20:47:25.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e45c1d38-7409-41fb-b6cb-c8f594574772 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23912024-12-06T20:47:25.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e45c1d38-7409-41fb-b6cb-c8f594574772 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23922024-12-06T20:47:26.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 693f2dca-7698-4ae7-8ef3-a61bd617dd13 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23932024-12-06T20:47:26.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 693f2dca-7698-4ae7-8ef3-a61bd617dd13 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23942024-12-06T20:47:26.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 693f2dca-7698-4ae7-8ef3-a61bd617dd13 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23952024-12-06T20:47:27.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b6f86e64-92fd-48c6-8668-ad0370a964c9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23962024-12-06T20:47:27.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b6f86e64-92fd-48c6-8668-ad0370a964c9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23972024-12-06T20:47:27.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b6f86e64-92fd-48c6-8668-ad0370a964c9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
23982024-12-06T20:47:27.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 815e1535-d5d3-4155-b3a3-3d89cbfef91a roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
23992024-12-06T20:47:27.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 815e1535-d5d3-4155-b3a3-3d89cbfef91a resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
24002024-12-06T20:47:27.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 815e1535-d5d3-4155-b3a3-3d89cbfef91a response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
24012024-12-06T20:47:27.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 395dcb7e-4d20-4f14-b025-4d8ba90298d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
24022024-12-06T20:47:27.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 395dcb7e-4d20-4f14-b025-4d8ba90298d3 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
24032024-12-06T20:47:27.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 395dcb7e-4d20-4f14-b025-4d8ba90298d3 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
24042024-12-06T20:47:28.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6b96a5f0-a5c8-4862-b1b6-73a0e58512d6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
24052024-12-06T20:47:28.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6b96a5f0-a5c8-4862-b1b6-73a0e58512d6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
24062024-12-06T20:47:28.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6b96a5f0-a5c8-4862-b1b6-73a0e58512d6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
24072024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
24082024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
24092024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24102024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
24112024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
24122024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
24132024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
24142024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24152024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
24162024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
24172024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24182024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
24192024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24202024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
24212024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
24222024-12-06T20:47:28.855ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:37:28.855339718 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
24232024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
24242024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
24252024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
24262024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
24272024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
24282024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24292024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24302024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
24312024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24322024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
24332024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24342024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
24352024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24362024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
24372024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24382024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
24392024-12-06T20:47:28.855ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
24402024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24412024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
24422024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24432024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
24442024-12-06T20:47:28.855ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
24452024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.26\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
24462024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
24472024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24482024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24492024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
24502024-12-06T20:47:28.855ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24512024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24522024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
24532024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
24542024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24552024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24562024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
24572024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
24582024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
24592024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24602024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24612024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
24622024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24632024-12-06T20:47:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24642024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
24652024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24662024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
24672024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24682024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
24692024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
24702024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
24712024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24722024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24732024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24742024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24752024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
24762024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24772024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24782024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24792024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24802024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24812024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24822024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24832024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24842024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24852024-12-06T20:47:28.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6379, tv_nsec: 193652913 } })
24862024-12-06T20:47:28.856ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6379, tv_nsec: 193665024 } })
24872024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24882024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24892024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24902024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24912024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24922024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24932024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24942024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24952024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24962024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24972024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24982024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24992024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25002024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25012024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25022024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25032024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25042024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25052024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
25062024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.640372ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
25072024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25082024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
25092024-12-06T20:47:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.709814ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
25102024-12-06T20:47:28.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6379, tv_nsec: 194968927 } })
25112024-12-06T20:47:28.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25122024-12-06T20:47:28.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
25132024-12-06T20:47:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25142024-12-06T20:47:28.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25152024-12-06T20:47:28.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25162024-12-06T20:47:28.859ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:37:28.855339718 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
25172024-12-06T20:47:28.859ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.63376ms iteration = 4 status = {"expiration":"2024-12-06T20:37:28.855339718Z","pruned":[]}
25182024-12-06T20:47:28.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25192024-12-06T20:47:28.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25202024-12-06T20:47:28.861ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.484827ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
25212024-12-06T20:47:28.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25222024-12-06T20:47:28.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25232024-12-06T20:47:28.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25242024-12-06T20:47:28.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25252024-12-06T20:47:28.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25262024-12-06T20:47:28.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25272024-12-06T20:47:28.865ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25282024-12-06T20:47:28.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25292024-12-06T20:47:28.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25302024-12-06T20:47:28.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25312024-12-06T20:47:28.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25322024-12-06T20:47:28.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25332024-12-06T20:47:28.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25342024-12-06T20:47:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25352024-12-06T20:47:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25362024-12-06T20:47:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25372024-12-06T20:47:28.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25382024-12-06T20:47:28.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25392024-12-06T20:47:28.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.773095ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
25402024-12-06T20:47:28.869ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25412024-12-06T20:47:28.870ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6379, tv_nsec: 207422119 } })
25422024-12-06T20:47:28.870ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
25432024-12-06T20:47:28.870ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25442024-12-06T20:47:28.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25452024-12-06T20:47:28.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.997063ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
25462024-12-06T20:47:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25472024-12-06T20:47:28.873ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25482024-12-06T20:47:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25492024-12-06T20:47:28.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25502024-12-06T20:47:28.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25512024-12-06T20:47:28.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25522024-12-06T20:47:28.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25532024-12-06T20:47:28.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25542024-12-06T20:47:28.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25552024-12-06T20:47:28.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25562024-12-06T20:47:28.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25572024-12-06T20:47:28.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25582024-12-06T20:47:28.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25592024-12-06T20:47:28.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25602024-12-06T20:47:28.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25612024-12-06T20:47:28.885ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25622024-12-06T20:47:28.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25632024-12-06T20:47:28.885ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25642024-12-06T20:47:28.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25652024-12-06T20:47:28.887ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25662024-12-06T20:47:28.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25672024-12-06T20:47:28.887ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25682024-12-06T20:47:28.893ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25692024-12-06T20:47:28.893ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25702024-12-06T20:47:28.893ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25712024-12-06T20:47:28.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25722024-12-06T20:47:28.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25732024-12-06T20:47:28.894ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25742024-12-06T20:47:28.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25752024-12-06T20:47:28.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25762024-12-06T20:47:28.897ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25772024-12-06T20:47:28.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25782024-12-06T20:47:28.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25792024-12-06T20:47:28.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25802024-12-06T20:47:28.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25812024-12-06T20:47:28.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25822024-12-06T20:47:28.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25832024-12-06T20:47:28.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25842024-12-06T20:47:28.903ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25852024-12-06T20:47:28.903ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
25862024-12-06T20:47:28.903ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
25872024-12-06T20:47:28.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25882024-12-06T20:47:28.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25892024-12-06T20:47:28.904ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25902024-12-06T20:47:28.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25912024-12-06T20:47:28.904ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.654774ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25922024-12-06T20:47:28.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25932024-12-06T20:47:28.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25942024-12-06T20:47:28.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25952024-12-06T20:47:28.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25962024-12-06T20:47:28.911ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25972024-12-06T20:47:28.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25982024-12-06T20:47:28.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25992024-12-06T20:47:28.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26002024-12-06T20:47:28.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26012024-12-06T20:47:28.920ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26022024-12-06T20:47:28.920ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26032024-12-06T20:47:28.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26042024-12-06T20:47:28.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26052024-12-06T20:47:28.921ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 66.086844ms iteration = 3 status = {"nsuccess":5}
26062024-12-06T20:47:28.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26072024-12-06T20:47:28.922ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6379, tv_nsec: 259805749 } })
26082024-12-06T20:47:28.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26092024-12-06T20:47:28.923ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
26102024-12-06T20:47:28.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26112024-12-06T20:47:28.924ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26122024-12-06T20:47:28.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26132024-12-06T20:47:28.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26142024-12-06T20:47:28.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26152024-12-06T20:47:28.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26162024-12-06T20:47:28.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26172024-12-06T20:47:28.927ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26182024-12-06T20:47:28.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26192024-12-06T20:47:28.927ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26202024-12-06T20:47:28.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
26212024-12-06T20:47:28.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26222024-12-06T20:47:28.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26232024-12-06T20:47:28.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26242024-12-06T20:47:28.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26252024-12-06T20:47:28.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.025194ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26262024-12-06T20:47:28.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26272024-12-06T20:47:28.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26282024-12-06T20:47:28.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26292024-12-06T20:47:28.960ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
26302024-12-06T20:47:28.960ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
26312024-12-06T20:47:28.960ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 104.574946ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
26322024-12-06T20:47:28.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26332024-12-06T20:47:28.961ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
26342024-12-06T20:47:28.961ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.721715ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
26352024-12-06T20:47:28.965ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
26362024-12-06T20:47:28.965ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
26372024-12-06T20:47:28.965ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 110.364225ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
26382024-12-06T20:47:28.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26392024-12-06T20:47:28.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26402024-12-06T20:47:28.970ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 114.224824ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26412024-12-06T20:47:28.975ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26422024-12-06T20:47:28.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26432024-12-06T20:47:28.976ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26442024-12-06T20:47:28.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26452024-12-06T20:47:28.978ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26462024-12-06T20:47:28.981ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26472024-12-06T20:47:28.981ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26482024-12-06T20:47:28.981ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.409763ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26492024-12-06T20:47:28.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
26502024-12-06T20:47:28.981ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26512024-12-06T20:47:28.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26522024-12-06T20:47:28.984ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
26532024-12-06T20:47:28.984ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
26542024-12-06T20:47:28.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26552024-12-06T20:47:28.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26562024-12-06T20:47:28.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26572024-12-06T20:47:28.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26582024-12-06T20:47:28.987ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 131.814108ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26592024-12-06T20:47:29.011ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 155.885219ms iteration = 9 status = {"physical_disks_added":0}
26602024-12-06T20:47:29.027ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26612024-12-06T20:47:29.027ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26622024-12-06T20:47:29.028ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "804310b8-e31f-430b-a894-a469aba004a0", "content-length": "26", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
26632024-12-06T20:47:29.028ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26642024-12-06T20:47:29.029ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26652024-12-06T20:47:29.077ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
26662024-12-06T20:47:29.077ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
26672024-12-06T20:47:29.077ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
26682024-12-06T20:47:29.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26692024-12-06T20:47:29.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26702024-12-06T20:47:29.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e8df844c-a953-4327-a2a9-c65e025d0a26 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
26712024-12-06T20:47:29.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e8df844c-a953-4327-a2a9-c65e025d0a26 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
26722024-12-06T20:47:29.125ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26732024-12-06T20:47:29.155ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26742024-12-06T20:47:29.155ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26752024-12-06T20:47:29.155ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5daf780a-063e-435f-93df-1c7a847a9165", "content-length": "26", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
26762024-12-06T20:47:29.155ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26772024-12-06T20:47:29.157ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26782024-12-06T20:47:29.162ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26792024-12-06T20:47:29.216ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 361.214102ms iteration = 7 status = {}
26802024-12-06T20:47:29.296ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
26812024-12-06T20:47:29.296ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26822024-12-06T20:47:29.296ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "428c75f7-a7ae-4371-97ec-4c40d4021dff", "content-length": "26", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
26832024-12-06T20:47:29.296ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26842024-12-06T20:47:29.297ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
26852024-12-06T20:47:29.315ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26862024-12-06T20:47:29.315ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "179f15da-7336-4ba3-9754-aad976165e42", "content-length": "1", "date": "Fri, 06 Dec 2024 20:47:28 GMT"} })
26872024-12-06T20:47:29.317ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26882024-12-06T20:47:29.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26892024-12-06T20:47:29.322ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26902024-12-06T20:47:29.334ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26912024-12-06T20:47:29.335ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26922024-12-06T20:47:29.335ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a80b18ac-5a70-487d-8f29-480c28ff9f3e", "content-length": "372", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
26932024-12-06T20:47:29.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26942024-12-06T20:47:29.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26952024-12-06T20:47:29.337ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 481.271487ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26962024-12-06T20:47:29.339ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26972024-12-06T20:47:29.339ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26982024-12-06T20:47:29.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26992024-12-06T20:47:29.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27002024-12-06T20:47:29.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e8df844c-a953-4327-a2a9-c65e025d0a26 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
27012024-12-06T20:47:29.341ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 486.167003ms iteration = 7 status = null
27022024-12-06T20:47:29.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27032024-12-06T20:47:29.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27042024-12-06T20:47:29.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27052024-12-06T20:47:29.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27062024-12-06T20:47:29.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27072024-12-06T20:47:29.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27082024-12-06T20:47:29.345ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27092024-12-06T20:47:29.346ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
27102024-12-06T20:47:29.346ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
27112024-12-06T20:47:29.346ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
27122024-12-06T20:47:29.346ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 491.605683ms iteration = 4 status = {"generation":2}
27132024-12-06T20:47:29.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
27142024-12-06T20:47:29.348ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27152024-12-06T20:47:29.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27162024-12-06T20:47:29.349ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 494.307524ms iteration = 7 status = 0
27172024-12-06T20:47:29.367ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27182024-12-06T20:47:29.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27192024-12-06T20:47:29.369ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27202024-12-06T20:47:29.372ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
27212024-12-06T20:47:29.372ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27222024-12-06T20:47:29.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27232024-12-06T20:47:29.373ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 517.900012ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
27242024-12-06T20:47:29.374ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
27252024-12-06T20:47:29.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ec0398c0-890c-4642-8271-522ebad97fb2", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27262024-12-06T20:47:29.374ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27272024-12-06T20:47:29.375ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6d5fc0c9-bc50-46df-8839-50c0e9403b0c", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27282024-12-06T20:47:29.375ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27292024-12-06T20:47:29.377ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27302024-12-06T20:47:29.377ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 522.050749ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
27312024-12-06T20:47:29.385ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
27322024-12-06T20:47:29.385ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
27332024-12-06T20:47:29.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27342024-12-06T20:47:29.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27352024-12-06T20:47:29.386ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
27362024-12-06T20:47:29.386ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27372024-12-06T20:47:29.387ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "72018575-2cec-48c5-83f4-036e1dd49958", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
27382024-12-06T20:47:29.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27392024-12-06T20:47:29.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27402024-12-06T20:47:29.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27412024-12-06T20:47:29.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27422024-12-06T20:47:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27432024-12-06T20:47:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27442024-12-06T20:47:29.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27452024-12-06T20:47:29.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27462024-12-06T20:47:29.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27472024-12-06T20:47:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27482024-12-06T20:47:29.396ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
27492024-12-06T20:47:29.396ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
27502024-12-06T20:47:29.396ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
27512024-12-06T20:47:29.396ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 541.331026ms iteration = 4 status = {"generation":1}
27522024-12-06T20:47:29.398ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27532024-12-06T20:47:29.398ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27542024-12-06T20:47:29.399ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "90331ea7-534b-411d-aca3-76b1dc0cc6b2", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
27552024-12-06T20:47:29.400ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 545.126883ms iteration = 7 status = {}
27562024-12-06T20:47:29.402ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
27572024-12-06T20:47:29.402ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 546.875349ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
27582024-12-06T20:47:29.413ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) }
27592024-12-06T20:47:29.413ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 557.885112ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
27602024-12-06T20:47:29.435ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27612024-12-06T20:47:29.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27622024-12-06T20:47:29.475ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27632024-12-06T20:47:29.477ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27642024-12-06T20:47:29.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27652024-12-06T20:47:29.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27662024-12-06T20:47:29.479ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27672024-12-06T20:47:29.480ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
27682024-12-06T20:47:29.481ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27692024-12-06T20:47:29.481ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e1fe3f1e-e887-415a-8d5f-6aed7dad9db8", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27702024-12-06T20:47:29.481ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27712024-12-06T20:47:29.481ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27722024-12-06T20:47:29.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27732024-12-06T20:47:29.482ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6e06140c-8cd7-443e-9961-9ecc01a7035e", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27742024-12-06T20:47:29.482ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27752024-12-06T20:47:29.484ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "cfdbb2af-56d1-4370-8be3-bbcf63c8f297", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27762024-12-06T20:47:29.484ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27772024-12-06T20:47:29.485ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
27782024-12-06T20:47:29.485ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 630.556485ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27792024-12-06T20:47:29.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27802024-12-06T20:47:29.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27812024-12-06T20:47:29.536ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
27822024-12-06T20:47:29.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27832024-12-06T20:47:29.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27842024-12-06T20:47:29.547ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27852024-12-06T20:47:29.547ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f21a37f-cab7-4aba-a5c5-c81a9ab3a567", "content-length": "134", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
27862024-12-06T20:47:29.547ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27872024-12-06T20:47:29.547ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
27882024-12-06T20:47:29.547ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27892024-12-06T20:47:29.547ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27902024-12-06T20:47:29.547ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27912024-12-06T20:47:29.547ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27922024-12-06T20:47:29.547ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27932024-12-06T20:47:29.547ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27942024-12-06T20:47:29.548ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27952024-12-06T20:47:29.548ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27962024-12-06T20:47:29.548ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
27972024-12-06T20:47:29.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27982024-12-06T20:47:29.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27992024-12-06T20:47:29.549ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
28002024-12-06T20:47:29.550ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "68c9696e-d521-47c4-8de8-4aecc4d6950c", "content-length": "2", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
28012024-12-06T20:47:29.550ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
28022024-12-06T20:47:29.550ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b6fb20c-d4f5-4e3c-9365-467879b04e88", "content-length": "52", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
28032024-12-06T20:47:29.550ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
28042024-12-06T20:47:29.550ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
28052024-12-06T20:47:29.644ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dca94efc-f528-4977-9bce-387476f0f20e", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
28062024-12-06T20:47:29.644ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
28072024-12-06T20:47:29.644ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
28082024-12-06T20:47:29.644ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "89890f98-d3a2-4300-843f-c9b19e7c07bc", "content-length": "682", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
28092024-12-06T20:47:29.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28102024-12-06T20:47:29.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28112024-12-06T20:47:29.648ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28122024-12-06T20:47:29.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28132024-12-06T20:47:29.677ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28142024-12-06T20:47:29.678ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fb61476-0d18-49eb-a944-2fad1da95e35", "content-length": "691", "date": "Fri, 06 Dec 2024 20:47:29 GMT"} })
28152024-12-06T20:47:29.678ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
28162024-12-06T20:47:29.678ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
28172024-12-06T20:47:29.678ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
28182024-12-06T20:47:29.679ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 823.304505ms iteration = 7 status = {}
28192024-12-06T20:47:29.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28202024-12-06T20:47:29.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28212024-12-06T20:47:29.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28222024-12-06T20:47:29.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28232024-12-06T20:47:29.689ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 834.287337ms iteration = 7 status = {}
28242024-12-06T20:47:30.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f32e9ffc-6fb2-432b-b784-683126300433 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28252024-12-06T20:47:30.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f32e9ffc-6fb2-432b-b784-683126300433 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28262024-12-06T20:47:30.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f32e9ffc-6fb2-432b-b784-683126300433 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28272024-12-06T20:47:31.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1ddc255b-7a7c-414a-a670-0783ff06743d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28282024-12-06T20:47:31.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1ddc255b-7a7c-414a-a670-0783ff06743d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28292024-12-06T20:47:31.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1ddc255b-7a7c-414a-a670-0783ff06743d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28302024-12-06T20:47:32.416ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 551 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 82a7f432-e493-4274-8fa6-8fea7ec58aff response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
28312024-12-06T20:47:32.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 242d894e-1fa4-4661-b7e0-585953228a88 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28322024-12-06T20:47:32.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 242d894e-1fa4-4661-b7e0-585953228a88 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28332024-12-06T20:47:32.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 242d894e-1fa4-4661-b7e0-585953228a88 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28342024-12-06T20:47:33.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 279a1b12-e459-4fa5-8f3b-edc6aa12ba39 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28352024-12-06T20:47:33.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 279a1b12-e459-4fa5-8f3b-edc6aa12ba39 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28362024-12-06T20:47:33.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 279a1b12-e459-4fa5-8f3b-edc6aa12ba39 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28372024-12-06T20:47:34.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f9e08814-1dcf-4e5a-9980-135b376b42c0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28382024-12-06T20:47:34.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f9e08814-1dcf-4e5a-9980-135b376b42c0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28392024-12-06T20:47:34.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2679 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f9e08814-1dcf-4e5a-9980-135b376b42c0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28402024-12-06T20:47:35.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a8a9c13-bfd3-499e-831b-d35cdf631347 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28412024-12-06T20:47:35.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a8a9c13-bfd3-499e-831b-d35cdf631347 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28422024-12-06T20:47:35.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a8a9c13-bfd3-499e-831b-d35cdf631347 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28432024-12-06T20:47:36.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5a3a2e65-9f77-4045-9472-646d9f56e294 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28442024-12-06T20:47:36.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5a3a2e65-9f77-4045-9472-646d9f56e294 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28452024-12-06T20:47:36.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5a3a2e65-9f77-4045-9472-646d9f56e294 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28462024-12-06T20:47:37.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6c9d73d-ce70-4ee3-89e9-b16acabfb160 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28472024-12-06T20:47:37.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6c9d73d-ce70-4ee3-89e9-b16acabfb160 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28482024-12-06T20:47:37.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6c9d73d-ce70-4ee3-89e9-b16acabfb160 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28492024-12-06T20:47:38.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a6a2f9a2-1ac0-4419-b200-36c90b1d1e06 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28502024-12-06T20:47:38.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a6a2f9a2-1ac0-4419-b200-36c90b1d1e06 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28512024-12-06T20:47:38.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a6a2f9a2-1ac0-4419-b200-36c90b1d1e06 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28522024-12-06T20:47:38.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
28532024-12-06T20:47:38.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
28542024-12-06T20:47:38.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28552024-12-06T20:47:38.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28562024-12-06T20:47:38.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28572024-12-06T20:47:38.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28582024-12-06T20:47:38.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28592024-12-06T20:47:38.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28602024-12-06T20:47:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28612024-12-06T20:47:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28622024-12-06T20:47:38.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28632024-12-06T20:47:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28642024-12-06T20:47:38.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28652024-12-06T20:47:38.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28662024-12-06T20:47:38.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28672024-12-06T20:47:38.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
28682024-12-06T20:47:38.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28692024-12-06T20:47:38.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28702024-12-06T20:47:38.878ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
28712024-12-06T20:47:38.878ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.462359ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
28722024-12-06T20:47:38.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.533714ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28732024-12-06T20:47:39.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1736669c-34f5-4dbd-9989-e6e4325e15d1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28742024-12-06T20:47:39.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1736669c-34f5-4dbd-9989-e6e4325e15d1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28752024-12-06T20:47:39.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1736669c-34f5-4dbd-9989-e6e4325e15d1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28762024-12-06T20:47:40.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 354d9d4c-1772-451a-92ea-e32b464812f1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28772024-12-06T20:47:40.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 354d9d4c-1772-451a-92ea-e32b464812f1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28782024-12-06T20:47:40.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 354d9d4c-1772-451a-92ea-e32b464812f1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28792024-12-06T20:47:41.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 91d82f5b-4f25-4380-9583-67fbd038c117 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28802024-12-06T20:47:41.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 91d82f5b-4f25-4380-9583-67fbd038c117 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28812024-12-06T20:47:41.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 91d82f5b-4f25-4380-9583-67fbd038c117 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28822024-12-06T20:47:42.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 5581649f-965f-4f67-a08b-69af9f2d0c33 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
28832024-12-06T20:47:42.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 5581649f-965f-4f67-a08b-69af9f2d0c33 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
28842024-12-06T20:47:42.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 5581649f-965f-4f67-a08b-69af9f2d0c33 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
28852024-12-06T20:47:42.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 13cc64da-6252-4f39-9e05-81db5b99a130 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
28862024-12-06T20:47:42.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 13cc64da-6252-4f39-9e05-81db5b99a130 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
28872024-12-06T20:47:42.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 13cc64da-6252-4f39-9e05-81db5b99a130 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
28882024-12-06T20:47:42.416ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 478 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 0efbcdac-d97c-4189-baa2-ca5236c1abaa response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
28892024-12-06T20:47:42.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3ed6c958-4e74-4f68-b8b8-0a819091fce5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28902024-12-06T20:47:42.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3ed6c958-4e74-4f68-b8b8-0a819091fce5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28912024-12-06T20:47:42.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3ed6c958-4e74-4f68-b8b8-0a819091fce5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28922024-12-06T20:47:43.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a86c727b-a752-4dec-8659-9a24efc1e60b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28932024-12-06T20:47:43.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a86c727b-a752-4dec-8659-9a24efc1e60b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28942024-12-06T20:47:43.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a86c727b-a752-4dec-8659-9a24efc1e60b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28952024-12-06T20:47:44.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = acebf144-dcfb-43f8-9c70-84583358facf roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28962024-12-06T20:47:44.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = acebf144-dcfb-43f8-9c70-84583358facf resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28972024-12-06T20:47:44.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = acebf144-dcfb-43f8-9c70-84583358facf response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28982024-12-06T20:47:45.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 788e6da4-5db2-4e91-bc14-f7757a8202ed roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
28992024-12-06T20:47:45.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 788e6da4-5db2-4e91-bc14-f7757a8202ed resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29002024-12-06T20:47:45.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 788e6da4-5db2-4e91-bc14-f7757a8202ed response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29012024-12-06T20:47:46.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b1f3787f-098e-4951-8f1f-b5a4f8c07744 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29022024-12-06T20:47:46.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b1f3787f-098e-4951-8f1f-b5a4f8c07744 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29032024-12-06T20:47:46.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b1f3787f-098e-4951-8f1f-b5a4f8c07744 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29042024-12-06T20:47:47.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cd3896be-2285-4163-9a73-bc12a54ac45c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29052024-12-06T20:47:47.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cd3896be-2285-4163-9a73-bc12a54ac45c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29062024-12-06T20:47:47.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cd3896be-2285-4163-9a73-bc12a54ac45c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29072024-12-06T20:47:48.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cb76716e-a267-4fa3-867e-628745019d15 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29082024-12-06T20:47:48.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cb76716e-a267-4fa3-867e-628745019d15 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29092024-12-06T20:47:48.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cb76716e-a267-4fa3-867e-628745019d15 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29102024-12-06T20:47:48.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
29112024-12-06T20:47:48.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
29122024-12-06T20:47:48.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29132024-12-06T20:47:48.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29142024-12-06T20:47:48.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29152024-12-06T20:47:48.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29162024-12-06T20:47:48.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29172024-12-06T20:47:48.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29182024-12-06T20:47:48.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29192024-12-06T20:47:48.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29202024-12-06T20:47:48.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29212024-12-06T20:47:48.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29222024-12-06T20:47:48.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29232024-12-06T20:47:48.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
29242024-12-06T20:47:48.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29252024-12-06T20:47:48.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29262024-12-06T20:47:48.877ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
29272024-12-06T20:47:48.877ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.956176ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
29282024-12-06T20:47:48.886ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29292024-12-06T20:47:48.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29302024-12-06T20:47:48.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.483593ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29312024-12-06T20:47:49.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 71d65ef3-fbf3-458f-b24b-5f5070429e5e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29322024-12-06T20:47:49.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 71d65ef3-fbf3-458f-b24b-5f5070429e5e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29332024-12-06T20:47:49.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 71d65ef3-fbf3-458f-b24b-5f5070429e5e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29342024-12-06T20:47:50.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 74b17ef5-b42b-4048-96c1-f68703fa2da4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29352024-12-06T20:47:50.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 74b17ef5-b42b-4048-96c1-f68703fa2da4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29362024-12-06T20:47:50.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 74b17ef5-b42b-4048-96c1-f68703fa2da4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29372024-12-06T20:47:51.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70386085-d724-4f8f-ad8e-4dfa03011ea0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29382024-12-06T20:47:51.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70386085-d724-4f8f-ad8e-4dfa03011ea0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29392024-12-06T20:47:51.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70386085-d724-4f8f-ad8e-4dfa03011ea0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29402024-12-06T20:47:52.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 409 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 1c11f0e6-5915-42a3-9562-21c7de4905a5 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
29412024-12-06T20:47:52.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab29858a-af85-4331-8e69-92fe501f78cc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29422024-12-06T20:47:52.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab29858a-af85-4331-8e69-92fe501f78cc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29432024-12-06T20:47:52.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab29858a-af85-4331-8e69-92fe501f78cc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29442024-12-06T20:47:53.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d6051bfd-64df-42ff-80eb-7c55317c8435 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29452024-12-06T20:47:53.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d6051bfd-64df-42ff-80eb-7c55317c8435 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29462024-12-06T20:47:53.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d6051bfd-64df-42ff-80eb-7c55317c8435 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29472024-12-06T20:47:54.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d154d46-c0d4-449a-b34f-95893f1f0b6f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29482024-12-06T20:47:54.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d154d46-c0d4-449a-b34f-95893f1f0b6f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29492024-12-06T20:47:54.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d154d46-c0d4-449a-b34f-95893f1f0b6f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29502024-12-06T20:47:55.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 56ce840e-2ee3-42f7-8a77-627b4926fae9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29512024-12-06T20:47:55.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 56ce840e-2ee3-42f7-8a77-627b4926fae9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29522024-12-06T20:47:55.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 56ce840e-2ee3-42f7-8a77-627b4926fae9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29532024-12-06T20:47:56.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c37580d4-f5b1-4738-86bb-58939fe84de7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29542024-12-06T20:47:56.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c37580d4-f5b1-4738-86bb-58939fe84de7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29552024-12-06T20:47:56.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c37580d4-f5b1-4738-86bb-58939fe84de7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29562024-12-06T20:47:57.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = f5eeb52e-e4b9-4a40-8b63-cdb86d8e51ca roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
29572024-12-06T20:47:57.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = f5eeb52e-e4b9-4a40-8b63-cdb86d8e51ca resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
29582024-12-06T20:47:57.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = f5eeb52e-e4b9-4a40-8b63-cdb86d8e51ca response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
29592024-12-06T20:47:57.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = dcae2738-1e59-445f-a423-fd1454ca4750 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
29602024-12-06T20:47:57.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = dcae2738-1e59-445f-a423-fd1454ca4750 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
29612024-12-06T20:47:57.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = dcae2738-1e59-445f-a423-fd1454ca4750 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
29622024-12-06T20:47:57.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a7d5eaa9-2af0-4a1c-96d2-b82bc80e35b3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29632024-12-06T20:47:57.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a7d5eaa9-2af0-4a1c-96d2-b82bc80e35b3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29642024-12-06T20:47:57.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a7d5eaa9-2af0-4a1c-96d2-b82bc80e35b3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
29652024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
29662024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29672024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29682024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
29692024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
29702024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29712024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29722024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
29732024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29742024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
29752024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29762024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29772024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
29782024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
29792024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29802024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
29812024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29822024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
29832024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29842024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29852024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
29862024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29872024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
29882024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
29892024-12-06T20:47:58.855ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29902024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29912024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29922024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
29932024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
29942024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
29952024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29962024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29972024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
29982024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29992024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30002024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
30012024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30022024-12-06T20:47:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30032024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30042024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
30052024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30062024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30072024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30082024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30092024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30102024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30112024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30122024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30132024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30142024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30152024-12-06T20:47:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30162024-12-06T20:47:58.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30172024-12-06T20:47:58.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6409, tv_nsec: 195364368 } })
30182024-12-06T20:47:58.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
30192024-12-06T20:47:58.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30202024-12-06T20:47:58.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30212024-12-06T20:47:58.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6409, tv_nsec: 198745685 } })
30222024-12-06T20:47:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30232024-12-06T20:47:58.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30242024-12-06T20:47:58.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
30252024-12-06T20:47:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30262024-12-06T20:47:58.862ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30272024-12-06T20:47:58.862ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30282024-12-06T20:47:58.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30292024-12-06T20:47:58.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30302024-12-06T20:47:58.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30312024-12-06T20:47:58.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30322024-12-06T20:47:58.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.443784ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
30332024-12-06T20:47:58.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30342024-12-06T20:47:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30352024-12-06T20:47:58.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30362024-12-06T20:47:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30372024-12-06T20:47:58.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30382024-12-06T20:47:58.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30392024-12-06T20:47:58.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30402024-12-06T20:47:58.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30412024-12-06T20:47:58.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30422024-12-06T20:47:58.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30432024-12-06T20:47:58.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30442024-12-06T20:47:58.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30452024-12-06T20:47:58.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30462024-12-06T20:47:58.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30472024-12-06T20:47:58.873ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 17.665395ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30482024-12-06T20:47:58.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30492024-12-06T20:47:58.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30502024-12-06T20:47:58.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30512024-12-06T20:47:58.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30522024-12-06T20:47:58.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30532024-12-06T20:47:58.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30542024-12-06T20:47:58.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30552024-12-06T20:47:58.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30562024-12-06T20:47:58.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30572024-12-06T20:47:58.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30582024-12-06T20:47:58.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30592024-12-06T20:47:58.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
30602024-12-06T20:47:58.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30612024-12-06T20:47:58.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30622024-12-06T20:47:58.909ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
30632024-12-06T20:47:58.909ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.980402ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
30642024-12-06T20:47:58.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30652024-12-06T20:47:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30662024-12-06T20:47:58.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30672024-12-06T20:47:58.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.677759ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30682024-12-06T20:47:58.923ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30692024-12-06T20:47:58.923ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30702024-12-06T20:47:58.923ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30712024-12-06T20:47:58.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30722024-12-06T20:47:58.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30732024-12-06T20:47:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30742024-12-06T20:47:58.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30752024-12-06T20:47:58.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30762024-12-06T20:47:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30772024-12-06T20:47:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30782024-12-06T20:47:58.925ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30792024-12-06T20:47:58.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.922852ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
30802024-12-06T20:47:58.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30812024-12-06T20:47:58.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30822024-12-06T20:47:58.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30832024-12-06T20:47:58.927ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30842024-12-06T20:47:58.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30852024-12-06T20:47:58.927ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6409, tv_nsec: 265271840 } })
30862024-12-06T20:47:58.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30872024-12-06T20:47:58.928ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
30882024-12-06T20:47:58.929ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30892024-12-06T20:47:58.929ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30902024-12-06T20:47:58.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30912024-12-06T20:47:58.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
30922024-12-06T20:47:58.932ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30932024-12-06T20:47:58.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30942024-12-06T20:47:58.935ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.547111ms iteration = 8 status = 0
30952024-12-06T20:47:58.939ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30962024-12-06T20:47:58.939ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.363829ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30972024-12-06T20:47:58.955ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 99.561317ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30982024-12-06T20:47:58.960ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30992024-12-06T20:47:58.960ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31002024-12-06T20:47:58.960ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.101289ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31012024-12-06T20:47:58.961ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31022024-12-06T20:47:58.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31032024-12-06T20:47:58.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31042024-12-06T20:47:58.961ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31052024-12-06T20:47:58.961ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "161baa48-0b08-41f8-ad0f-145607400e9c", "content-length": "26", "date": "Fri, 06 Dec 2024 20:47:58 GMT"} })
31062024-12-06T20:47:58.961ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31072024-12-06T20:47:58.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31082024-12-06T20:47:58.964ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31092024-12-06T20:47:58.964ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31102024-12-06T20:47:58.964ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0c33812-e2ae-4648-bc2e-2745431d0678", "content-length": "26", "date": "Fri, 06 Dec 2024 20:47:58 GMT"} })
31112024-12-06T20:47:58.964ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31122024-12-06T20:47:58.966ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31132024-12-06T20:47:58.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.004633ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31142024-12-06T20:47:58.976ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 120.357293ms iteration = 10 status = {"physical_disks_added":0}
31152024-12-06T20:47:58.998ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 142.520894ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31162024-12-06T20:47:59.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31172024-12-06T20:47:59.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31182024-12-06T20:47:59.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05680839-5b2b-43aa-ab06-5fa7a9fe0fb4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
31192024-12-06T20:47:59.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05680839-5b2b-43aa-ab06-5fa7a9fe0fb4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
31202024-12-06T20:47:59.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05680839-5b2b-43aa-ab06-5fa7a9fe0fb4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
31212024-12-06T20:47:59.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31222024-12-06T20:47:59.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31232024-12-06T20:47:59.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31242024-12-06T20:47:59.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31252024-12-06T20:47:59.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31262024-12-06T20:47:59.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31272024-12-06T20:47:59.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31282024-12-06T20:47:59.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31292024-12-06T20:47:59.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31302024-12-06T20:47:59.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31312024-12-06T20:47:59.086ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31322024-12-06T20:47:59.087ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a93eae0-8dd0-4e85-a908-8c4645e716da", "content-length": "1", "date": "Fri, 06 Dec 2024 20:47:58 GMT"} })
31332024-12-06T20:47:59.088ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31342024-12-06T20:47:59.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31352024-12-06T20:47:59.090ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 235.576554ms iteration = 8 status = null
31362024-12-06T20:47:59.237ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
31372024-12-06T20:47:59.237ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31382024-12-06T20:47:59.237ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5da2de69-fd7a-4180-9d59-81bc9deb4931", "content-length": "26", "date": "Fri, 06 Dec 2024 20:47:59 GMT"} })
31392024-12-06T20:47:59.237ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31402024-12-06T20:47:59.238ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31412024-12-06T20:47:59.238ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
31422024-12-06T20:47:59.239ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e4536b0-82fc-49a9-a09c-ffbceba3f0a6", "content-length": "691", "date": "Fri, 06 Dec 2024 20:47:59 GMT"} })
31432024-12-06T20:47:59.239ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
31442024-12-06T20:47:59.239ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
31452024-12-06T20:47:59.239ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
31462024-12-06T20:47:59.240ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 384.852522ms iteration = 8 status = {}
31472024-12-06T20:47:59.267ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31482024-12-06T20:47:59.267ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31492024-12-06T20:47:59.267ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a0efa5e-b623-46a6-8a69-8074c68c338f", "content-length": "372", "date": "Fri, 06 Dec 2024 20:47:59 GMT"} })
31502024-12-06T20:47:59.267ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31512024-12-06T20:47:59.267ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 411.777556ms iteration = 8 status = {}
31522024-12-06T20:47:59.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31532024-12-06T20:47:59.307ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
31542024-12-06T20:47:59.307ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31552024-12-06T20:47:59.307ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "75463d3b-2f7b-48d0-a9a7-bf8ea39b117e", "date": "Fri, 06 Dec 2024 20:47:59 GMT"} })
31562024-12-06T20:47:59.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31572024-12-06T20:47:59.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31582024-12-06T20:47:59.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31592024-12-06T20:47:59.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31602024-12-06T20:47:59.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31612024-12-06T20:47:59.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31622024-12-06T20:47:59.316ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31632024-12-06T20:47:59.316ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31642024-12-06T20:47:59.316ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "705c07c9-e3c4-4e80-aaec-6d4ce0623008", "date": "Fri, 06 Dec 2024 20:47:59 GMT"} })
31652024-12-06T20:47:59.318ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 462.671608ms iteration = 8 status = {}
31662024-12-06T20:47:59.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31672024-12-06T20:47:59.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31682024-12-06T20:47:59.349ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
31692024-12-06T20:47:59.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31702024-12-06T20:47:59.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31712024-12-06T20:47:59.358ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
31722024-12-06T20:47:59.359ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "35917242-b311-42c3-856f-bbdadb87dd67", "content-length": "134", "date": "Fri, 06 Dec 2024 20:47:58 GMT"} })
31732024-12-06T20:47:59.359ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
31742024-12-06T20:47:59.359ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
31752024-12-06T20:47:59.359ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31762024-12-06T20:47:59.359ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31772024-12-06T20:47:59.359ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31782024-12-06T20:47:59.359ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31792024-12-06T20:47:59.359ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31802024-12-06T20:47:59.359ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31812024-12-06T20:47:59.359ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31822024-12-06T20:47:59.359ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31832024-12-06T20:47:59.359ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
31842024-12-06T20:47:59.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31852024-12-06T20:47:59.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31862024-12-06T20:47:59.362ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
31872024-12-06T20:47:59.362ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee424149-64f5-4f23-ad7f-bf382decde0d", "content-length": "2", "date": "Fri, 06 Dec 2024 20:47:58 GMT"} })
31882024-12-06T20:47:59.362ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31892024-12-06T20:47:59.362ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d86628c-4839-4624-812a-ba7ade09375f", "content-length": "52", "date": "Fri, 06 Dec 2024 20:47:58 GMT"} })
31902024-12-06T20:47:59.362ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
31912024-12-06T20:47:59.362ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31922024-12-06T20:47:59.363ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
31932024-12-06T20:47:59.363ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
31942024-12-06T20:47:59.394ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
31952024-12-06T20:47:59.394ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:63660
31962024-12-06T20:47:59.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63660 req_id = 3b933abb-3739-4513-ad34-3f3b807f3dec roles = RoleSet { roles: {} } uri = /metrics/producers
31972024-12-06T20:47:59.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63660 req_id = 3b933abb-3739-4513-ad34-3f3b807f3dec resource = Database result = Ok(()) uri = /metrics/producers
31982024-12-06T20:47:59.434ZINFOnexus: assigned collector to new producer collector_id = bef145b4-2934-45c3-870a-63d45572bde4 file = nexus/src/app/oximeter.rs:76 producer_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
31992024-12-06T20:47:59.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39581 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63660 req_id = 3b933abb-3739-4513-ad34-3f3b807f3dec response_code = 201 uri = /metrics/producers
32002024-12-06T20:47:59.434ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3b933abb-3739-4513-ad34-3f3b807f3dec", "content-length": "41", "date": "Fri, 06 Dec 2024 20:47:59 GMT"} })
32012024-12-06T20:47:59.435ZDEBGnexus (producer-registration-task): registered with nexus successfully
32022024-12-06T20:47:59.435ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
32032024-12-06T20:47:59.463ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7df03899-6a18-4111-8334-0e9e97ff1f60", "date": "Fri, 06 Dec 2024 20:47:59 GMT"} })
32042024-12-06T20:47:59.463ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
32052024-12-06T20:47:59.463ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32062024-12-06T20:47:59.463ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8132f91d-cc8f-4a7a-9828-50361196554b", "content-length": "682", "date": "Fri, 06 Dec 2024 20:47:59 GMT"} })
32072024-12-06T20:47:59.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32082024-12-06T20:47:59.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32092024-12-06T20:47:59.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32102024-12-06T20:47:59.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32112024-12-06T20:47:59.470ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32122024-12-06T20:47:59.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32132024-12-06T20:47:59.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32142024-12-06T20:47:59.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32152024-12-06T20:47:59.479ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 623.232837ms iteration = 8 status = {}
32162024-12-06T20:48:00.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 08aad69c-6301-48cd-a14e-dfbaf470754f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32172024-12-06T20:48:00.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 08aad69c-6301-48cd-a14e-dfbaf470754f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32182024-12-06T20:48:00.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 08aad69c-6301-48cd-a14e-dfbaf470754f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32192024-12-06T20:48:01.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a26b1402-d575-4b98-8d98-0e676510df7d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32202024-12-06T20:48:01.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a26b1402-d575-4b98-8d98-0e676510df7d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32212024-12-06T20:48:01.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a26b1402-d575-4b98-8d98-0e676510df7d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32222024-12-06T20:48:02.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 604a6321-2446-4456-8072-20a07ea82fc1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32232024-12-06T20:48:02.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 604a6321-2446-4456-8072-20a07ea82fc1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32242024-12-06T20:48:02.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 604a6321-2446-4456-8072-20a07ea82fc1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32252024-12-06T20:48:02.416ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 460 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 02774bc7-3e73-4208-a2d5-22c52f421368 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
32262024-12-06T20:48:03.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 531c99e2-8ecf-4d96-aa36-3fc8a5cf52c3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32272024-12-06T20:48:03.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 531c99e2-8ecf-4d96-aa36-3fc8a5cf52c3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32282024-12-06T20:48:03.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 531c99e2-8ecf-4d96-aa36-3fc8a5cf52c3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32292024-12-06T20:48:04.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d5d0e9f1-8f56-4c75-b341-3c143923bcc2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32302024-12-06T20:48:04.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d5d0e9f1-8f56-4c75-b341-3c143923bcc2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32312024-12-06T20:48:04.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d5d0e9f1-8f56-4c75-b341-3c143923bcc2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32322024-12-06T20:48:05.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5779477d-c7f2-4f05-badc-eb1a00fab1df roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32332024-12-06T20:48:05.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5779477d-c7f2-4f05-badc-eb1a00fab1df resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32342024-12-06T20:48:05.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5779477d-c7f2-4f05-badc-eb1a00fab1df response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32352024-12-06T20:48:06.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e2016a15-f2ec-498c-be1c-4b71b246f46d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32362024-12-06T20:48:06.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e2016a15-f2ec-498c-be1c-4b71b246f46d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32372024-12-06T20:48:06.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e2016a15-f2ec-498c-be1c-4b71b246f46d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32382024-12-06T20:48:07.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2403cca7-98dc-4f71-8774-1baefd3059df roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32392024-12-06T20:48:07.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2403cca7-98dc-4f71-8774-1baefd3059df resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32402024-12-06T20:48:07.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2403cca7-98dc-4f71-8774-1baefd3059df response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32412024-12-06T20:48:08.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c5bf32e-1c85-4521-bdbd-9510b36f9c3c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32422024-12-06T20:48:08.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c5bf32e-1c85-4521-bdbd-9510b36f9c3c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32432024-12-06T20:48:08.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c5bf32e-1c85-4521-bdbd-9510b36f9c3c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32442024-12-06T20:48:08.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
32452024-12-06T20:48:08.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
32462024-12-06T20:48:08.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32472024-12-06T20:48:08.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32482024-12-06T20:48:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32492024-12-06T20:48:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32502024-12-06T20:48:08.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32512024-12-06T20:48:08.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32522024-12-06T20:48:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32532024-12-06T20:48:08.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.48813ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32542024-12-06T20:48:08.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32552024-12-06T20:48:08.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32562024-12-06T20:48:08.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32572024-12-06T20:48:08.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32582024-12-06T20:48:08.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32592024-12-06T20:48:08.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32602024-12-06T20:48:08.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
32612024-12-06T20:48:08.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32622024-12-06T20:48:08.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32632024-12-06T20:48:08.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
32642024-12-06T20:48:08.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.974658ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
32652024-12-06T20:48:09.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5391d247-ea9e-4ec9-bba1-451792024bbb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32662024-12-06T20:48:09.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5391d247-ea9e-4ec9-bba1-451792024bbb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32672024-12-06T20:48:09.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5391d247-ea9e-4ec9-bba1-451792024bbb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32682024-12-06T20:48:10.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8ad43dd6-06da-4668-87e9-2e82ee4f0cbe roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32692024-12-06T20:48:10.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8ad43dd6-06da-4668-87e9-2e82ee4f0cbe resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32702024-12-06T20:48:10.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8ad43dd6-06da-4668-87e9-2e82ee4f0cbe response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32712024-12-06T20:48:11.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ee79d208-3585-4e1e-9397-c97fb0791595 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32722024-12-06T20:48:11.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ee79d208-3585-4e1e-9397-c97fb0791595 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32732024-12-06T20:48:11.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ee79d208-3585-4e1e-9397-c97fb0791595 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32742024-12-06T20:48:12.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 478d2855-00fd-44b5-9e6f-c9920d4d33a2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32752024-12-06T20:48:12.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 478d2855-00fd-44b5-9e6f-c9920d4d33a2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32762024-12-06T20:48:12.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 478d2855-00fd-44b5-9e6f-c9920d4d33a2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32772024-12-06T20:48:12.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 0e0a1c7a-a150-42c4-bd6b-258af8effdd2 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
32782024-12-06T20:48:12.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 0e0a1c7a-a150-42c4-bd6b-258af8effdd2 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
32792024-12-06T20:48:12.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 0e0a1c7a-a150-42c4-bd6b-258af8effdd2 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
32802024-12-06T20:48:12.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = ccc85641-5542-4c19-bbfb-d6f0045912a3 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
32812024-12-06T20:48:12.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = ccc85641-5542-4c19-bbfb-d6f0045912a3 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
32822024-12-06T20:48:12.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = ccc85641-5542-4c19-bbfb-d6f0045912a3 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
32832024-12-06T20:48:12.416ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = bd963cfc-1828-461d-b1ec-ee6d09480187 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
32842024-12-06T20:48:13.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3df5d68e-57cc-46ab-815b-97e05b61b24f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32852024-12-06T20:48:13.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3df5d68e-57cc-46ab-815b-97e05b61b24f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32862024-12-06T20:48:13.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3df5d68e-57cc-46ab-815b-97e05b61b24f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32872024-12-06T20:48:14.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 84aeee65-32a5-4a2e-af07-d3524c0dbb26 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32882024-12-06T20:48:14.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 84aeee65-32a5-4a2e-af07-d3524c0dbb26 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32892024-12-06T20:48:14.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 84aeee65-32a5-4a2e-af07-d3524c0dbb26 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32902024-12-06T20:48:15.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 852b3517-c04d-40a1-96f0-d9cf9e687357 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32912024-12-06T20:48:15.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 852b3517-c04d-40a1-96f0-d9cf9e687357 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32922024-12-06T20:48:15.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 852b3517-c04d-40a1-96f0-d9cf9e687357 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32932024-12-06T20:48:16.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 418ebc02-79df-48de-b697-028232c49c47 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32942024-12-06T20:48:16.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 418ebc02-79df-48de-b697-028232c49c47 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32952024-12-06T20:48:16.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 418ebc02-79df-48de-b697-028232c49c47 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32962024-12-06T20:48:17.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 836dda20-b9ee-4792-8b8f-a55ce51b4006 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32972024-12-06T20:48:17.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 836dda20-b9ee-4792-8b8f-a55ce51b4006 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32982024-12-06T20:48:17.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 836dda20-b9ee-4792-8b8f-a55ce51b4006 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
32992024-12-06T20:48:18.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 39f95c4a-b9cb-430b-8ed1-1276719af6b1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33002024-12-06T20:48:18.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 39f95c4a-b9cb-430b-8ed1-1276719af6b1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33012024-12-06T20:48:18.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 39f95c4a-b9cb-430b-8ed1-1276719af6b1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33022024-12-06T20:48:18.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
33032024-12-06T20:48:18.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
33042024-12-06T20:48:18.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33052024-12-06T20:48:18.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33062024-12-06T20:48:18.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33072024-12-06T20:48:18.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33082024-12-06T20:48:18.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33092024-12-06T20:48:18.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33102024-12-06T20:48:18.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33112024-12-06T20:48:18.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.079835ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33122024-12-06T20:48:18.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33132024-12-06T20:48:18.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33142024-12-06T20:48:18.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33152024-12-06T20:48:18.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33162024-12-06T20:48:18.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33172024-12-06T20:48:18.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33182024-12-06T20:48:18.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
33192024-12-06T20:48:18.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33202024-12-06T20:48:18.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33212024-12-06T20:48:18.881ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
33222024-12-06T20:48:18.881ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.182995ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
33232024-12-06T20:48:19.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4c5a0fd5-326c-4a5e-9bee-32da45ff9dcc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33242024-12-06T20:48:19.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4c5a0fd5-326c-4a5e-9bee-32da45ff9dcc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33252024-12-06T20:48:19.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4c5a0fd5-326c-4a5e-9bee-32da45ff9dcc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33262024-12-06T20:48:20.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de2689ea-6442-4489-8b1f-839b385127c6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33272024-12-06T20:48:20.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de2689ea-6442-4489-8b1f-839b385127c6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33282024-12-06T20:48:20.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de2689ea-6442-4489-8b1f-839b385127c6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33292024-12-06T20:48:21.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3240f86d-38ce-492f-bbb9-2bf41e9629c2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33302024-12-06T20:48:21.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3240f86d-38ce-492f-bbb9-2bf41e9629c2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33312024-12-06T20:48:21.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3240f86d-38ce-492f-bbb9-2bf41e9629c2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33322024-12-06T20:48:22.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = b405f814-4543-41e0-986d-6d5277c012ce response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
33332024-12-06T20:48:22.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bad0260a-9274-4ec7-b824-557dcac3c159 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33342024-12-06T20:48:22.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bad0260a-9274-4ec7-b824-557dcac3c159 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33352024-12-06T20:48:22.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bad0260a-9274-4ec7-b824-557dcac3c159 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33362024-12-06T20:48:23.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cc68a7e1-041b-40d4-8380-a2b7bc044b5c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33372024-12-06T20:48:23.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cc68a7e1-041b-40d4-8380-a2b7bc044b5c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33382024-12-06T20:48:23.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cc68a7e1-041b-40d4-8380-a2b7bc044b5c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33392024-12-06T20:48:24.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3fca1264-591e-43e0-a474-03084f386dc2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33402024-12-06T20:48:24.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3fca1264-591e-43e0-a474-03084f386dc2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33412024-12-06T20:48:24.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3fca1264-591e-43e0-a474-03084f386dc2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33422024-12-06T20:48:25.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76e9c0ea-49c1-40cc-bc1b-64de99e3ab76 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33432024-12-06T20:48:25.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76e9c0ea-49c1-40cc-bc1b-64de99e3ab76 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33442024-12-06T20:48:25.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76e9c0ea-49c1-40cc-bc1b-64de99e3ab76 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33452024-12-06T20:48:26.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76210dc7-4b5b-474b-a3ca-b0eb9b7a7c76 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33462024-12-06T20:48:26.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76210dc7-4b5b-474b-a3ca-b0eb9b7a7c76 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33472024-12-06T20:48:26.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76210dc7-4b5b-474b-a3ca-b0eb9b7a7c76 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33482024-12-06T20:48:27.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = be57de25-1383-4e2d-822b-2ec142c95662 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33492024-12-06T20:48:27.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = be57de25-1383-4e2d-822b-2ec142c95662 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33502024-12-06T20:48:27.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = be57de25-1383-4e2d-822b-2ec142c95662 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33512024-12-06T20:48:28.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c93515a-d4f3-4c5f-bc9b-2eca5c3fd13a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33522024-12-06T20:48:28.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c93515a-d4f3-4c5f-bc9b-2eca5c3fd13a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33532024-12-06T20:48:28.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c93515a-d4f3-4c5f-bc9b-2eca5c3fd13a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
33542024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
33552024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
33562024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33572024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
33582024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
33592024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
33602024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33612024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33622024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
33632024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
33642024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33652024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33662024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33672024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
33682024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
33692024-12-06T20:48:28.854ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:38:28.854686072 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33702024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33712024-12-06T20:48:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33722024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33732024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33742024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33752024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33762024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
33772024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33782024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
33792024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33802024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
33812024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33822024-12-06T20:48:28.855ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6439, tv_nsec: 193117810 } })
33832024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
33842024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33852024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
33862024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33872024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
33882024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33892024-12-06T20:48:28.855ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6439, tv_nsec: 193291564 } })
33902024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
33912024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33922024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33932024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33942024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
33952024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
33962024-12-06T20:48:28.855ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33972024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
33982024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33992024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
34002024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34012024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
34022024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
34032024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34042024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
34052024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
34062024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
34072024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34082024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
34092024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34102024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34112024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34122024-12-06T20:48:28.855ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
34132024-12-06T20:48:28.855ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
34142024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
34152024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
34162024-12-06T20:48:28.856ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
34172024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34182024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
34192024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.1\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
34202024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
34212024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
34222024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34232024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
34242024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
34252024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34262024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34272024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34282024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34292024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34302024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
34312024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34322024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34332024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
34342024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.634242ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
34352024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34362024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34372024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34382024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34392024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
34402024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34412024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34422024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34432024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
34442024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.695494ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
34452024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34462024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34472024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34482024-12-06T20:48:28.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34492024-12-06T20:48:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34502024-12-06T20:48:28.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6439, tv_nsec: 195029029 } })
34512024-12-06T20:48:28.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
34522024-12-06T20:48:28.858ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:38:28.854686072 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34532024-12-06T20:48:28.858ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.032113ms iteration = 5 status = {"expiration":"2024-12-06T20:38:28.854686072Z","pruned":[]}
34542024-12-06T20:48:28.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34552024-12-06T20:48:28.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34562024-12-06T20:48:28.860ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34572024-12-06T20:48:28.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34582024-12-06T20:48:28.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34592024-12-06T20:48:28.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34602024-12-06T20:48:28.861ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34612024-12-06T20:48:28.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34622024-12-06T20:48:28.862ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.536788ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34632024-12-06T20:48:28.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34642024-12-06T20:48:28.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34652024-12-06T20:48:28.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34662024-12-06T20:48:28.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34672024-12-06T20:48:28.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34682024-12-06T20:48:28.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34692024-12-06T20:48:28.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34702024-12-06T20:48:28.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.077164ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
34712024-12-06T20:48:28.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34722024-12-06T20:48:28.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34732024-12-06T20:48:28.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34742024-12-06T20:48:28.868ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
34752024-12-06T20:48:28.868ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34762024-12-06T20:48:28.868ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 13.083237ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34772024-12-06T20:48:28.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34782024-12-06T20:48:28.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34792024-12-06T20:48:28.873ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34802024-12-06T20:48:28.873ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.604734ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
34812024-12-06T20:48:28.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34822024-12-06T20:48:28.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34832024-12-06T20:48:28.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34842024-12-06T20:48:28.876ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6439, tv_nsec: 214210804 } })
34852024-12-06T20:48:28.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34862024-12-06T20:48:28.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34872024-12-06T20:48:28.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34882024-12-06T20:48:28.876ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
34892024-12-06T20:48:28.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34902024-12-06T20:48:28.877ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34912024-12-06T20:48:28.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34922024-12-06T20:48:28.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34932024-12-06T20:48:28.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34942024-12-06T20:48:28.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34952024-12-06T20:48:28.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34962024-12-06T20:48:28.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34972024-12-06T20:48:28.891ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6439, tv_nsec: 228888232 } })
34982024-12-06T20:48:28.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34992024-12-06T20:48:28.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35002024-12-06T20:48:28.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35012024-12-06T20:48:28.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35022024-12-06T20:48:28.892ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
35032024-12-06T20:48:28.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35042024-12-06T20:48:28.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35052024-12-06T20:48:28.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35062024-12-06T20:48:28.895ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35072024-12-06T20:48:28.895ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35082024-12-06T20:48:28.895ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35092024-12-06T20:48:28.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35102024-12-06T20:48:28.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35112024-12-06T20:48:28.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35122024-12-06T20:48:28.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35132024-12-06T20:48:28.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
35142024-12-06T20:48:28.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35152024-12-06T20:48:28.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35162024-12-06T20:48:28.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35172024-12-06T20:48:28.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35182024-12-06T20:48:28.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35192024-12-06T20:48:28.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35202024-12-06T20:48:28.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35212024-12-06T20:48:28.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35222024-12-06T20:48:28.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35232024-12-06T20:48:28.931ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
35242024-12-06T20:48:28.931ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.43272ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
35252024-12-06T20:48:28.932ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35262024-12-06T20:48:28.932ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35272024-12-06T20:48:28.932ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35282024-12-06T20:48:28.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35292024-12-06T20:48:28.933ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35302024-12-06T20:48:28.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35312024-12-06T20:48:28.940ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35322024-12-06T20:48:28.940ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35332024-12-06T20:48:28.940ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35342024-12-06T20:48:28.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35352024-12-06T20:48:28.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 85.436932ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
35362024-12-06T20:48:28.947ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35372024-12-06T20:48:28.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35382024-12-06T20:48:28.951ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35392024-12-06T20:48:28.951ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35402024-12-06T20:48:28.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35412024-12-06T20:48:28.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35422024-12-06T20:48:28.952ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35432024-12-06T20:48:28.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35442024-12-06T20:48:28.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35452024-12-06T20:48:28.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35462024-12-06T20:48:28.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35472024-12-06T20:48:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35482024-12-06T20:48:28.957ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35492024-12-06T20:48:28.958ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35502024-12-06T20:48:28.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35512024-12-06T20:48:28.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35522024-12-06T20:48:28.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35532024-12-06T20:48:28.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
35542024-12-06T20:48:28.962ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35552024-12-06T20:48:28.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35562024-12-06T20:48:28.963ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35572024-12-06T20:48:28.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35582024-12-06T20:48:28.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35592024-12-06T20:48:28.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35602024-12-06T20:48:28.963ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35612024-12-06T20:48:28.963ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
35622024-12-06T20:48:28.963ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 108.22544ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35632024-12-06T20:48:28.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35642024-12-06T20:48:28.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35652024-12-06T20:48:28.965ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
35662024-12-06T20:48:28.965ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
35672024-12-06T20:48:28.965ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
35682024-12-06T20:48:28.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35692024-12-06T20:48:28.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35702024-12-06T20:48:28.966ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35712024-12-06T20:48:28.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 110.919159ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35722024-12-06T20:48:28.966ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 111.172697ms iteration = 11 status = {"physical_disks_added":0}
35732024-12-06T20:48:28.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35742024-12-06T20:48:28.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35752024-12-06T20:48:28.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35762024-12-06T20:48:28.968ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.434794ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35772024-12-06T20:48:28.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
35782024-12-06T20:48:28.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35792024-12-06T20:48:28.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35802024-12-06T20:48:28.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35812024-12-06T20:48:28.973ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.065094ms iteration = 9 status = 0
35822024-12-06T20:48:28.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35832024-12-06T20:48:28.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35842024-12-06T20:48:28.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35852024-12-06T20:48:28.977ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35862024-12-06T20:48:28.977ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
35872024-12-06T20:48:28.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35882024-12-06T20:48:28.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35892024-12-06T20:48:28.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35902024-12-06T20:48:28.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35912024-12-06T20:48:28.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35922024-12-06T20:48:28.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35932024-12-06T20:48:28.986ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
35942024-12-06T20:48:28.986ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
35952024-12-06T20:48:28.986ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
35962024-12-06T20:48:28.986ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 131.806678ms iteration = 5 status = {"generation":2}
35972024-12-06T20:48:28.987ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 131.812468ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35982024-12-06T20:48:28.994ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35992024-12-06T20:48:28.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
36002024-12-06T20:48:28.998ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36012024-12-06T20:48:28.998ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36022024-12-06T20:48:28.998ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36032024-12-06T20:48:28.998ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.182052ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36042024-12-06T20:48:28.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36052024-12-06T20:48:29.000ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 144.709811ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36062024-12-06T20:48:29.000ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36072024-12-06T20:48:29.000ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36082024-12-06T20:48:29.001ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "479645da-e13c-4028-9170-ada3f963e80a", "content-length": "26", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} })
36092024-12-06T20:48:29.001ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36102024-12-06T20:48:29.004ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36112024-12-06T20:48:29.008ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36122024-12-06T20:48:29.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 153.138478ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36132024-12-06T20:48:29.009ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
36142024-12-06T20:48:29.019ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36152024-12-06T20:48:29.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36162024-12-06T20:48:29.021ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36172024-12-06T20:48:29.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36182024-12-06T20:48:29.023ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36192024-12-06T20:48:29.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36202024-12-06T20:48:29.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36212024-12-06T20:48:29.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36222024-12-06T20:48:29.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36232024-12-06T20:48:29.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36242024-12-06T20:48:29.040ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36252024-12-06T20:48:29.040ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36262024-12-06T20:48:29.041ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "384d4814-ea01-40e0-b576-182235f59b2d", "content-length": "26", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} })
36272024-12-06T20:48:29.041ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36282024-12-06T20:48:29.041ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
36292024-12-06T20:48:29.041ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36302024-12-06T20:48:29.041ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4c6f9d7-be2d-4d17-833a-40716162f4d2", "content-length": "26", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} })
36312024-12-06T20:48:29.041ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36322024-12-06T20:48:29.043ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36332024-12-06T20:48:29.043ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
36342024-12-06T20:48:29.073ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
36352024-12-06T20:48:29.073ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
36362024-12-06T20:48:29.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36372024-12-06T20:48:29.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36382024-12-06T20:48:29.076ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36392024-12-06T20:48:29.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36402024-12-06T20:48:29.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36412024-12-06T20:48:29.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36422024-12-06T20:48:29.087ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) }
36432024-12-06T20:48:29.087ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 232.597837ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36442024-12-06T20:48:29.116ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
36452024-12-06T20:48:29.116ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 260.719942ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
36462024-12-06T20:48:29.224ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36472024-12-06T20:48:29.224ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d4a52304-35c0-4914-b671-995a32e45b30", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36482024-12-06T20:48:29.224ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36492024-12-06T20:48:29.226ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "fa855ddc-47af-4d3c-8980-2c0a5433d28a", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36502024-12-06T20:48:29.226ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36512024-12-06T20:48:29.228ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36522024-12-06T20:48:29.228ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 374.190246ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36532024-12-06T20:48:29.251ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 395.449025ms iteration = 9 status = {}
36542024-12-06T20:48:29.267ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36552024-12-06T20:48:29.268ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36562024-12-06T20:48:29.268ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "57f14098-12ff-4fd2-8924-3b1bfb302783", "content-length": "372", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} })
36572024-12-06T20:48:29.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36582024-12-06T20:48:29.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36592024-12-06T20:48:29.407ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36602024-12-06T20:48:29.407ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "88265349-c972-4ec3-a853-4725894155a4", "content-length": "1", "date": "Fri, 06 Dec 2024 20:48:28 GMT"} })
36612024-12-06T20:48:29.410ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36622024-12-06T20:48:29.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36632024-12-06T20:48:29.411ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
36642024-12-06T20:48:29.422ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36652024-12-06T20:48:29.425ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
36662024-12-06T20:48:29.425ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36672024-12-06T20:48:29.425ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
36682024-12-06T20:48:29.425ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 570.391325ms iteration = 5 status = {"generation":1}
36692024-12-06T20:48:29.425ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 570.625781ms iteration = 9 status = null
36702024-12-06T20:48:29.437ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "51ea0467-440a-4010-a9f7-f03a9b7097e9", "content-length": "691", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} })
36712024-12-06T20:48:29.437ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36722024-12-06T20:48:29.437ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36732024-12-06T20:48:29.437ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36742024-12-06T20:48:29.439ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 583.619576ms iteration = 9 status = {}
36752024-12-06T20:48:29.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36762024-12-06T20:48:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36772024-12-06T20:48:29.443ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
36782024-12-06T20:48:29.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36792024-12-06T20:48:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36802024-12-06T20:48:29.452ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36812024-12-06T20:48:29.452ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e4d9ed4-0b18-41ba-8d54-5d5a891d0e3a", "content-length": "134", "date": "Fri, 06 Dec 2024 20:48:28 GMT"} })
36822024-12-06T20:48:29.452ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36832024-12-06T20:48:29.452ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
36842024-12-06T20:48:29.452ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36852024-12-06T20:48:29.452ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36862024-12-06T20:48:29.452ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36872024-12-06T20:48:29.452ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36882024-12-06T20:48:29.452ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36892024-12-06T20:48:29.452ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36902024-12-06T20:48:29.452ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36912024-12-06T20:48:29.452ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36922024-12-06T20:48:29.453ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
36932024-12-06T20:48:29.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36942024-12-06T20:48:29.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36952024-12-06T20:48:29.454ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36962024-12-06T20:48:29.454ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "84da7f89-8a79-4e13-80fb-e6b1e5e23616", "content-length": "2", "date": "Fri, 06 Dec 2024 20:48:28 GMT"} })
36972024-12-06T20:48:29.454ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36982024-12-06T20:48:29.454ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9e1f1d6-e6e8-4e80-9711-0f5b434bf898", "content-length": "52", "date": "Fri, 06 Dec 2024 20:48:28 GMT"} })
36992024-12-06T20:48:29.454ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
37002024-12-06T20:48:29.454ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37012024-12-06T20:48:29.461ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37022024-12-06T20:48:29.461ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "45289744-615c-4098-b434-07fe49887636", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37032024-12-06T20:48:29.461ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37042024-12-06T20:48:29.462ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f98b99b1-4f93-49e1-b259-307a68248707", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37052024-12-06T20:48:29.462ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37062024-12-06T20:48:29.464ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "727b142a-24db-4020-a69b-92d3ccdea4e5", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37072024-12-06T20:48:29.464ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37082024-12-06T20:48:29.465ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
37092024-12-06T20:48:29.465ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 610.94117ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37102024-12-06T20:48:29.476ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
37112024-12-06T20:48:29.476ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37122024-12-06T20:48:29.551ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5a855717-04bb-41fe-ac5c-1c08874692cf", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} })
37132024-12-06T20:48:29.551ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
37142024-12-06T20:48:29.551ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37152024-12-06T20:48:29.551ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e8384498-6092-429f-896f-9ab4038a7397", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} })
37162024-12-06T20:48:29.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37172024-12-06T20:48:29.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37182024-12-06T20:48:29.552ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "50ab273c-7428-4bc9-b484-2d7a3e676d72", "content-length": "682", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} })
37192024-12-06T20:48:29.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37202024-12-06T20:48:29.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37212024-12-06T20:48:29.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37222024-12-06T20:48:29.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37232024-12-06T20:48:29.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37242024-12-06T20:48:29.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37252024-12-06T20:48:29.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37262024-12-06T20:48:29.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37272024-12-06T20:48:29.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37282024-12-06T20:48:29.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37292024-12-06T20:48:29.561ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37302024-12-06T20:48:29.561ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37312024-12-06T20:48:29.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37322024-12-06T20:48:29.562ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "289524a1-d057-4da8-9a32-765023653851", "date": "Fri, 06 Dec 2024 20:48:29 GMT"} })
37332024-12-06T20:48:29.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37342024-12-06T20:48:29.563ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 708.047493ms iteration = 9 status = {}
37352024-12-06T20:48:29.569ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 714.11913ms iteration = 9 status = {}
37362024-12-06T20:48:29.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 64e61a37-aba2-4745-b5b8-2042f1ff7a41 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37372024-12-06T20:48:29.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 64e61a37-aba2-4745-b5b8-2042f1ff7a41 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37382024-12-06T20:48:29.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 64e61a37-aba2-4745-b5b8-2042f1ff7a41 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37392024-12-06T20:48:30.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 53d98856-8aa2-403e-b567-24e9deceb66e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37402024-12-06T20:48:30.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 53d98856-8aa2-403e-b567-24e9deceb66e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37412024-12-06T20:48:30.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 53d98856-8aa2-403e-b567-24e9deceb66e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37422024-12-06T20:48:31.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d907404-0d92-4f51-99d4-660938eb0f53 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37432024-12-06T20:48:31.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d907404-0d92-4f51-99d4-660938eb0f53 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37442024-12-06T20:48:31.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d907404-0d92-4f51-99d4-660938eb0f53 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37452024-12-06T20:48:32.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = b5e38064-270e-4894-93f7-e6cc9b699bc0 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
37462024-12-06T20:48:32.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 61284d2d-e6c1-44c1-8b3e-d241789eb647 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37472024-12-06T20:48:32.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 61284d2d-e6c1-44c1-8b3e-d241789eb647 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37482024-12-06T20:48:32.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 61284d2d-e6c1-44c1-8b3e-d241789eb647 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37492024-12-06T20:48:33.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e367d09-1b4a-4c8c-bb6e-4d0d500dd6d9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37502024-12-06T20:48:33.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e367d09-1b4a-4c8c-bb6e-4d0d500dd6d9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37512024-12-06T20:48:33.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e367d09-1b4a-4c8c-bb6e-4d0d500dd6d9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37522024-12-06T20:48:34.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ebdf1f0b-c891-4e2a-9ca5-3eb410e818c5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37532024-12-06T20:48:34.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ebdf1f0b-c891-4e2a-9ca5-3eb410e818c5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37542024-12-06T20:48:34.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ebdf1f0b-c891-4e2a-9ca5-3eb410e818c5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37552024-12-06T20:48:35.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3e0cae36-77d9-4ad8-b288-d082411615e2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37562024-12-06T20:48:35.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3e0cae36-77d9-4ad8-b288-d082411615e2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37572024-12-06T20:48:35.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3e0cae36-77d9-4ad8-b288-d082411615e2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37582024-12-06T20:48:36.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b77e6fd9-5d84-4d2c-862f-01e777db7449 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37592024-12-06T20:48:36.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b77e6fd9-5d84-4d2c-862f-01e777db7449 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37602024-12-06T20:48:36.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b77e6fd9-5d84-4d2c-862f-01e777db7449 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37612024-12-06T20:48:37.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0618c8b3-b8c6-458d-93b4-7f731120a89e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37622024-12-06T20:48:37.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0618c8b3-b8c6-458d-93b4-7f731120a89e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37632024-12-06T20:48:37.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0618c8b3-b8c6-458d-93b4-7f731120a89e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37642024-12-06T20:48:38.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
37652024-12-06T20:48:38.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
37662024-12-06T20:48:38.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37672024-12-06T20:48:38.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37682024-12-06T20:48:38.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37692024-12-06T20:48:38.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37702024-12-06T20:48:38.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 478ec2b6-8ec8-426c-8174-00375f90d82f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37712024-12-06T20:48:38.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 478ec2b6-8ec8-426c-8174-00375f90d82f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37722024-12-06T20:48:38.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37732024-12-06T20:48:38.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37742024-12-06T20:48:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37752024-12-06T20:48:38.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 478ec2b6-8ec8-426c-8174-00375f90d82f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37762024-12-06T20:48:38.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.444039ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37772024-12-06T20:48:38.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37782024-12-06T20:48:38.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37792024-12-06T20:48:38.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37802024-12-06T20:48:38.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37812024-12-06T20:48:38.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37822024-12-06T20:48:38.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37832024-12-06T20:48:38.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
37842024-12-06T20:48:38.868ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37852024-12-06T20:48:38.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37862024-12-06T20:48:38.880ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
37872024-12-06T20:48:38.880ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.513468ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
37882024-12-06T20:48:39.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cdd40363-213b-46f5-bd19-c22a058ddf72 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37892024-12-06T20:48:39.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cdd40363-213b-46f5-bd19-c22a058ddf72 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37902024-12-06T20:48:39.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cdd40363-213b-46f5-bd19-c22a058ddf72 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37912024-12-06T20:48:40.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70835fa7-965a-43e8-9fd2-24760d64429d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37922024-12-06T20:48:40.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70835fa7-965a-43e8-9fd2-24760d64429d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37932024-12-06T20:48:40.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70835fa7-965a-43e8-9fd2-24760d64429d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37942024-12-06T20:48:41.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9346d973-cdee-4736-bd30-2caf153bcbdd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37952024-12-06T20:48:41.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9346d973-cdee-4736-bd30-2caf153bcbdd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37962024-12-06T20:48:41.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9346d973-cdee-4736-bd30-2caf153bcbdd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37972024-12-06T20:48:42.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 438 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = d5f6d324-4fa3-45b5-8495-a455a689aaa4 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
37982024-12-06T20:48:42.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0f9bfdd9-a09d-4663-92a9-49b4c6ecab95 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
37992024-12-06T20:48:42.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0f9bfdd9-a09d-4663-92a9-49b4c6ecab95 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38002024-12-06T20:48:42.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0f9bfdd9-a09d-4663-92a9-49b4c6ecab95 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38012024-12-06T20:48:43.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8b06266-6017-4e9e-8f8b-879b1c9839ed roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38022024-12-06T20:48:43.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8b06266-6017-4e9e-8f8b-879b1c9839ed resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38032024-12-06T20:48:43.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8b06266-6017-4e9e-8f8b-879b1c9839ed response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38042024-12-06T20:48:44.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 79cea51c-2588-4d80-be38-02ade80065ff roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38052024-12-06T20:48:44.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 79cea51c-2588-4d80-be38-02ade80065ff resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38062024-12-06T20:48:44.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 79cea51c-2588-4d80-be38-02ade80065ff response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38072024-12-06T20:48:46.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b6021b25-3a13-4120-a3b0-eb946225c59d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38082024-12-06T20:48:46.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b6021b25-3a13-4120-a3b0-eb946225c59d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38092024-12-06T20:48:46.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b6021b25-3a13-4120-a3b0-eb946225c59d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38102024-12-06T20:48:47.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0df30471-8672-42bd-8d29-6f6e5b94358b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38112024-12-06T20:48:47.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0df30471-8672-42bd-8d29-6f6e5b94358b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38122024-12-06T20:48:47.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0df30471-8672-42bd-8d29-6f6e5b94358b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38132024-12-06T20:48:48.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0ed7b785-ede3-4bba-82c0-dcb69f78e312 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38142024-12-06T20:48:48.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0ed7b785-ede3-4bba-82c0-dcb69f78e312 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38152024-12-06T20:48:48.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0ed7b785-ede3-4bba-82c0-dcb69f78e312 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38162024-12-06T20:48:48.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
38172024-12-06T20:48:48.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
38182024-12-06T20:48:48.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38192024-12-06T20:48:48.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38202024-12-06T20:48:48.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38212024-12-06T20:48:48.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38222024-12-06T20:48:48.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38232024-12-06T20:48:48.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38242024-12-06T20:48:48.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38252024-12-06T20:48:48.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38262024-12-06T20:48:48.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38272024-12-06T20:48:48.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38282024-12-06T20:48:48.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.682976ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38292024-12-06T20:48:48.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38302024-12-06T20:48:48.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38312024-12-06T20:48:48.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38322024-12-06T20:48:48.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
38332024-12-06T20:48:48.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38342024-12-06T20:48:48.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38352024-12-06T20:48:48.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
38362024-12-06T20:48:48.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.406606ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
38372024-12-06T20:48:49.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = af8beaa7-719e-4401-9348-ed7f856e5883 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38382024-12-06T20:48:49.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = af8beaa7-719e-4401-9348-ed7f856e5883 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38392024-12-06T20:48:49.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = af8beaa7-719e-4401-9348-ed7f856e5883 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38402024-12-06T20:48:50.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c58c97ae-de02-4b2c-8b9b-adbdf5166957 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38412024-12-06T20:48:50.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c58c97ae-de02-4b2c-8b9b-adbdf5166957 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38422024-12-06T20:48:50.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c58c97ae-de02-4b2c-8b9b-adbdf5166957 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38432024-12-06T20:48:51.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a457b65-b2b3-4221-b4fd-a803662fea10 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38442024-12-06T20:48:51.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a457b65-b2b3-4221-b4fd-a803662fea10 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38452024-12-06T20:48:51.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a457b65-b2b3-4221-b4fd-a803662fea10 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38462024-12-06T20:48:52.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e2aae67-f801-40d7-8ee9-d32ba76e9095 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38472024-12-06T20:48:52.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e2aae67-f801-40d7-8ee9-d32ba76e9095 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38482024-12-06T20:48:52.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e2aae67-f801-40d7-8ee9-d32ba76e9095 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38492024-12-06T20:48:52.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 524 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = e1f40a75-1217-47c2-9169-bdb69d0dd302 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
38502024-12-06T20:48:53.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de4d2e63-c3c8-418c-88e1-d2cb0f76d78a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38512024-12-06T20:48:53.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de4d2e63-c3c8-418c-88e1-d2cb0f76d78a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38522024-12-06T20:48:53.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de4d2e63-c3c8-418c-88e1-d2cb0f76d78a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38532024-12-06T20:48:54.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 010363bf-897f-44d9-a1ce-cab35517ba63 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38542024-12-06T20:48:54.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 010363bf-897f-44d9-a1ce-cab35517ba63 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38552024-12-06T20:48:54.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 010363bf-897f-44d9-a1ce-cab35517ba63 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38562024-12-06T20:48:55.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 90aaee8d-4d99-4386-876c-b03cbaabc499 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38572024-12-06T20:48:55.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 90aaee8d-4d99-4386-876c-b03cbaabc499 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38582024-12-06T20:48:55.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 90aaee8d-4d99-4386-876c-b03cbaabc499 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38592024-12-06T20:48:56.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c02bf707-37dd-476f-a3f2-18478ed2a508 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38602024-12-06T20:48:56.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c02bf707-37dd-476f-a3f2-18478ed2a508 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38612024-12-06T20:48:56.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c02bf707-37dd-476f-a3f2-18478ed2a508 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38622024-12-06T20:48:57.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3ef8f2a5-24ca-4403-9019-8b3f83f6ed19 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38632024-12-06T20:48:57.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3ef8f2a5-24ca-4403-9019-8b3f83f6ed19 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38642024-12-06T20:48:57.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3ef8f2a5-24ca-4403-9019-8b3f83f6ed19 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38652024-12-06T20:48:58.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d87329b-f599-4d64-b1da-b9f74b1baa58 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38662024-12-06T20:48:58.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d87329b-f599-4d64-b1da-b9f74b1baa58 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38672024-12-06T20:48:58.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d87329b-f599-4d64-b1da-b9f74b1baa58 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
38682024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
38692024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38702024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38712024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
38722024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38732024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
38742024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
38752024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
38762024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38772024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
38782024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38792024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38802024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38812024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
38822024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
38832024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38842024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38852024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
38862024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38872024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
38882024-12-06T20:48:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38892024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
38902024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38912024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
38922024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
38932024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38942024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
38952024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38962024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38972024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
38982024-12-06T20:48:58.855ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38992024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39002024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39012024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
39022024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39032024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39042024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
39052024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39062024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39072024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39082024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39092024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39102024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39112024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39122024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39132024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39142024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39152024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39162024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39172024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39182024-12-06T20:48:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39192024-12-06T20:48:58.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6469, tv_nsec: 194535055 } })
39202024-12-06T20:48:58.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
39212024-12-06T20:48:58.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6469, tv_nsec: 196120586 } })
39222024-12-06T20:48:58.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39232024-12-06T20:48:58.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
39242024-12-06T20:48:58.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39252024-12-06T20:48:58.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.692111ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
39262024-12-06T20:48:58.861ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39272024-12-06T20:48:58.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.21873ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
39282024-12-06T20:48:58.861ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.640872ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39292024-12-06T20:48:58.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39302024-12-06T20:48:58.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39312024-12-06T20:48:58.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39322024-12-06T20:48:58.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39332024-12-06T20:48:58.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39342024-12-06T20:48:58.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39352024-12-06T20:48:58.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39362024-12-06T20:48:58.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39372024-12-06T20:48:58.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39382024-12-06T20:48:58.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39392024-12-06T20:48:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39402024-12-06T20:48:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39412024-12-06T20:48:58.866ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39422024-12-06T20:48:58.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39432024-12-06T20:48:58.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39442024-12-06T20:48:58.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39452024-12-06T20:48:58.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39462024-12-06T20:48:58.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39472024-12-06T20:48:58.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39482024-12-06T20:48:58.868ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39492024-12-06T20:48:58.868ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39502024-12-06T20:48:58.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39512024-12-06T20:48:58.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39522024-12-06T20:48:58.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39532024-12-06T20:48:58.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39542024-12-06T20:48:58.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39552024-12-06T20:48:58.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39562024-12-06T20:48:58.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39572024-12-06T20:48:58.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39582024-12-06T20:48:58.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39592024-12-06T20:48:58.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39602024-12-06T20:48:58.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39612024-12-06T20:48:58.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39622024-12-06T20:48:58.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39632024-12-06T20:48:58.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39642024-12-06T20:48:58.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 20.187681ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
39652024-12-06T20:48:58.876ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6469, tv_nsec: 214359716 } })
39662024-12-06T20:48:58.876ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
39672024-12-06T20:48:58.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.745221ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39682024-12-06T20:48:58.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39692024-12-06T20:48:58.877ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39702024-12-06T20:48:58.877ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.002953ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39712024-12-06T20:48:58.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39722024-12-06T20:48:58.878ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39732024-12-06T20:48:58.878ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39742024-12-06T20:48:58.878ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39752024-12-06T20:48:58.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39762024-12-06T20:48:58.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39772024-12-06T20:48:58.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39782024-12-06T20:48:58.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
39792024-12-06T20:48:58.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39802024-12-06T20:48:58.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39812024-12-06T20:48:58.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39822024-12-06T20:48:58.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39832024-12-06T20:48:58.881ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39842024-12-06T20:48:58.881ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39852024-12-06T20:48:58.881ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39862024-12-06T20:48:58.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 26.838372ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39872024-12-06T20:48:58.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39882024-12-06T20:48:58.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39892024-12-06T20:48:58.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39902024-12-06T20:48:58.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39912024-12-06T20:48:58.893ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 38.710187ms iteration = 12 status = {"physical_disks_added":0}
39922024-12-06T20:48:58.895ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
39932024-12-06T20:48:58.895ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.860634ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
39942024-12-06T20:48:58.911ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39952024-12-06T20:48:58.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39962024-12-06T20:48:58.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39972024-12-06T20:48:58.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39982024-12-06T20:48:58.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39992024-12-06T20:48:58.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40002024-12-06T20:48:58.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40012024-12-06T20:48:58.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40022024-12-06T20:48:58.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.81774ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40032024-12-06T20:48:58.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40042024-12-06T20:48:58.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
40052024-12-06T20:48:58.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40062024-12-06T20:48:58.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40072024-12-06T20:48:58.925ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.854236ms iteration = 10 status = 0
40082024-12-06T20:48:58.955ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40092024-12-06T20:48:58.955ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40102024-12-06T20:48:58.955ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8d4d6df-539f-43b2-9cee-aa3980346923", "content-length": "26", "date": "Fri, 06 Dec 2024 20:48:58 GMT"} })
40112024-12-06T20:48:58.956ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40122024-12-06T20:48:58.958ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40132024-12-06T20:48:58.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.449953ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40142024-12-06T20:48:58.961ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40152024-12-06T20:48:58.961ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40162024-12-06T20:48:58.962ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "30f8eb5b-97ac-4a7c-8afc-8dd476e92915", "content-length": "26", "date": "Fri, 06 Dec 2024 20:48:58 GMT"} })
40172024-12-06T20:48:58.962ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40182024-12-06T20:48:58.963ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40192024-12-06T20:48:58.971ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
40202024-12-06T20:48:58.971ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40212024-12-06T20:48:58.972ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "737cf186-cbf8-4e00-88d0-77d6412f57a8", "content-length": "26", "date": "Fri, 06 Dec 2024 20:48:58 GMT"} })
40222024-12-06T20:48:58.972ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40232024-12-06T20:48:58.974ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
40242024-12-06T20:48:58.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40252024-12-06T20:48:58.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40262024-12-06T20:48:59.059ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40272024-12-06T20:48:59.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40282024-12-06T20:48:59.092ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40292024-12-06T20:48:59.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40302024-12-06T20:48:59.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40312024-12-06T20:48:59.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40322024-12-06T20:48:59.094ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40332024-12-06T20:48:59.094ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40342024-12-06T20:48:59.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b23eca6c-0aa4-40d2-8d79-a9ab7e902945", "content-length": "372", "date": "Fri, 06 Dec 2024 20:48:59 GMT"} })
40352024-12-06T20:48:59.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40362024-12-06T20:48:59.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40372024-12-06T20:48:59.124ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40382024-12-06T20:48:59.126ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40392024-12-06T20:48:59.126ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40402024-12-06T20:48:59.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40412024-12-06T20:48:59.142ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
40422024-12-06T20:48:59.142ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40432024-12-06T20:48:59.142ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7fe2fa74-fe6c-4fcf-aa57-6af5edd21acb", "date": "Fri, 06 Dec 2024 20:48:59 GMT"} })
40442024-12-06T20:48:59.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40452024-12-06T20:48:59.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40462024-12-06T20:48:59.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40472024-12-06T20:48:59.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40482024-12-06T20:48:59.165ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 310.672599ms iteration = 10 status = {}
40492024-12-06T20:48:59.176ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40502024-12-06T20:48:59.176ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "24a87468-882a-4341-9287-68df3e3e6b2c", "content-length": "1", "date": "Fri, 06 Dec 2024 20:48:58 GMT"} })
40512024-12-06T20:48:59.177ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40522024-12-06T20:48:59.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40532024-12-06T20:48:59.211ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40542024-12-06T20:48:59.213ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 359.663032ms iteration = 10 status = null
40552024-12-06T20:48:59.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40562024-12-06T20:48:59.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40572024-12-06T20:48:59.217ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40582024-12-06T20:48:59.217ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40592024-12-06T20:48:59.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40602024-12-06T20:48:59.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40612024-12-06T20:48:59.232ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
40622024-12-06T20:48:59.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40632024-12-06T20:48:59.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40642024-12-06T20:48:59.240ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "30e48a16-314b-4301-ba87-f4843648755c", "date": "Fri, 06 Dec 2024 20:48:59 GMT"} })
40652024-12-06T20:48:59.241ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd762ab5-c1aa-48d8-97b6-4a2af631a61b", "content-length": "691", "date": "Fri, 06 Dec 2024 20:48:59 GMT"} })
40662024-12-06T20:48:59.241ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40672024-12-06T20:48:59.241ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40682024-12-06T20:48:59.241ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40692024-12-06T20:48:59.242ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 387.273954ms iteration = 10 status = {}
40702024-12-06T20:48:59.242ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40712024-12-06T20:48:59.242ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "804bb650-5d0f-4773-9af9-a3c982b3a57c", "content-length": "134", "date": "Fri, 06 Dec 2024 20:48:58 GMT"} })
40722024-12-06T20:48:59.242ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40732024-12-06T20:48:59.242ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
40742024-12-06T20:48:59.243ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40752024-12-06T20:48:59.243ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40762024-12-06T20:48:59.243ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40772024-12-06T20:48:59.243ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40782024-12-06T20:48:59.243ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40792024-12-06T20:48:59.243ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40802024-12-06T20:48:59.243ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40812024-12-06T20:48:59.243ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40822024-12-06T20:48:59.243ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
40832024-12-06T20:48:59.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40842024-12-06T20:48:59.243ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 388.551627ms iteration = 10 status = {}
40852024-12-06T20:48:59.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40862024-12-06T20:48:59.245ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40872024-12-06T20:48:59.245ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a13aaaa-4b41-4ffd-acf4-d19e465f9f4a", "content-length": "2", "date": "Fri, 06 Dec 2024 20:48:58 GMT"} })
40882024-12-06T20:48:59.245ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40892024-12-06T20:48:59.245ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d67611c8-cbfd-43ed-8f27-cfccbbe626b7", "content-length": "52", "date": "Fri, 06 Dec 2024 20:48:58 GMT"} })
40902024-12-06T20:48:59.245ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
40912024-12-06T20:48:59.245ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40922024-12-06T20:48:59.336ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7fda3352-a88e-4d21-8218-d25cb76b2965", "date": "Fri, 06 Dec 2024 20:48:59 GMT"} })
40932024-12-06T20:48:59.336ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
40942024-12-06T20:48:59.336ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40952024-12-06T20:48:59.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9b63d809-55b6-4f93-883c-c424e8da64e8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
40962024-12-06T20:48:59.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9b63d809-55b6-4f93-883c-c424e8da64e8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
40972024-12-06T20:48:59.336ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "79f71f11-802f-4b0d-ba31-a96c6499343e", "content-length": "682", "date": "Fri, 06 Dec 2024 20:48:59 GMT"} })
40982024-12-06T20:48:59.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40992024-12-06T20:48:59.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41002024-12-06T20:48:59.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9b63d809-55b6-4f93-883c-c424e8da64e8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41012024-12-06T20:48:59.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41022024-12-06T20:48:59.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41032024-12-06T20:48:59.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41042024-12-06T20:48:59.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41052024-12-06T20:48:59.347ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41062024-12-06T20:48:59.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41072024-12-06T20:48:59.354ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 499.743104ms iteration = 10 status = {}
41082024-12-06T20:49:00.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab98208f-7dbc-43d3-a3bc-340f0364ef70 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41092024-12-06T20:49:00.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab98208f-7dbc-43d3-a3bc-340f0364ef70 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41102024-12-06T20:49:00.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab98208f-7dbc-43d3-a3bc-340f0364ef70 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41112024-12-06T20:49:01.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cc357d8a-b2da-488a-ae0f-c2d72f140c8b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41122024-12-06T20:49:01.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cc357d8a-b2da-488a-ae0f-c2d72f140c8b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41132024-12-06T20:49:01.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cc357d8a-b2da-488a-ae0f-c2d72f140c8b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41142024-12-06T20:49:02.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2950df80-9d42-4598-95f9-1617778fd1f9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41152024-12-06T20:49:02.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2950df80-9d42-4598-95f9-1617778fd1f9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41162024-12-06T20:49:02.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2950df80-9d42-4598-95f9-1617778fd1f9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41172024-12-06T20:49:02.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = b75cf80f-99e2-42a0-8624-2c6da75f56b6 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
41182024-12-06T20:49:03.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 847feef5-b401-4d46-93f8-9ea546896584 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41192024-12-06T20:49:03.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 847feef5-b401-4d46-93f8-9ea546896584 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41202024-12-06T20:49:03.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 847feef5-b401-4d46-93f8-9ea546896584 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41212024-12-06T20:49:04.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 82c8b53b-8325-4f68-8728-ec64d7714210 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41222024-12-06T20:49:04.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 82c8b53b-8325-4f68-8728-ec64d7714210 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41232024-12-06T20:49:04.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 82c8b53b-8325-4f68-8728-ec64d7714210 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41242024-12-06T20:49:05.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6192d072-e83d-4c86-8b12-03f2f8a1feec roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41252024-12-06T20:49:05.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6192d072-e83d-4c86-8b12-03f2f8a1feec resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41262024-12-06T20:49:05.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6192d072-e83d-4c86-8b12-03f2f8a1feec response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41272024-12-06T20:49:06.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a2bb6b7d-552d-4500-b577-ecc009987724 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41282024-12-06T20:49:06.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a2bb6b7d-552d-4500-b577-ecc009987724 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41292024-12-06T20:49:06.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a2bb6b7d-552d-4500-b577-ecc009987724 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41302024-12-06T20:49:07.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a3113700-bec8-4743-b34e-b07f05211e05 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41312024-12-06T20:49:07.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a3113700-bec8-4743-b34e-b07f05211e05 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41322024-12-06T20:49:07.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a3113700-bec8-4743-b34e-b07f05211e05 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41332024-12-06T20:49:08.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2b983623-3e4e-4bf7-a833-5736035b70d4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41342024-12-06T20:49:08.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2b983623-3e4e-4bf7-a833-5736035b70d4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41352024-12-06T20:49:08.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2b983623-3e4e-4bf7-a833-5736035b70d4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41362024-12-06T20:49:08.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
41372024-12-06T20:49:08.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
41382024-12-06T20:49:08.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41392024-12-06T20:49:08.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41402024-12-06T20:49:08.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41412024-12-06T20:49:08.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41422024-12-06T20:49:08.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41432024-12-06T20:49:08.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41442024-12-06T20:49:08.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41452024-12-06T20:49:08.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41462024-12-06T20:49:08.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41472024-12-06T20:49:08.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41482024-12-06T20:49:08.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41492024-12-06T20:49:08.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
41502024-12-06T20:49:08.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41512024-12-06T20:49:08.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41522024-12-06T20:49:08.882ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
41532024-12-06T20:49:08.882ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.958705ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
41542024-12-06T20:49:08.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41552024-12-06T20:49:08.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41562024-12-06T20:49:08.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.819264ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41572024-12-06T20:49:09.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 309c77a2-938c-4d0b-899d-db5afd83904c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41582024-12-06T20:49:09.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 309c77a2-938c-4d0b-899d-db5afd83904c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41592024-12-06T20:49:09.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 309c77a2-938c-4d0b-899d-db5afd83904c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41602024-12-06T20:49:10.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5a2a619d-8228-4ed2-80d9-8bfb776a22ba roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41612024-12-06T20:49:10.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5a2a619d-8228-4ed2-80d9-8bfb776a22ba resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41622024-12-06T20:49:10.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5a2a619d-8228-4ed2-80d9-8bfb776a22ba response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41632024-12-06T20:49:11.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9a059dca-1b4d-4ac6-a7b3-6bcf7d32da7e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41642024-12-06T20:49:11.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9a059dca-1b4d-4ac6-a7b3-6bcf7d32da7e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41652024-12-06T20:49:11.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9a059dca-1b4d-4ac6-a7b3-6bcf7d32da7e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41662024-12-06T20:49:12.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 440affaf-343b-4241-bf86-271ef4dae0f2 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
41672024-12-06T20:49:12.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 440affaf-343b-4241-bf86-271ef4dae0f2 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
41682024-12-06T20:49:12.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = 440affaf-343b-4241-bf86-271ef4dae0f2 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
41692024-12-06T20:49:12.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = d599e56a-aa8c-4658-86f3-76841b068d0b roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
41702024-12-06T20:49:12.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = d599e56a-aa8c-4658-86f3-76841b068d0b resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
41712024-12-06T20:49:12.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48129 req_id = d599e56a-aa8c-4658-86f3-76841b068d0b response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
41722024-12-06T20:49:12.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 502 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 4d2da73b-32ee-4854-bb79-0f7c1f9364ab response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
41732024-12-06T20:49:12.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 34bf046f-1fd5-4798-a0bd-c6ab04fe8143 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41742024-12-06T20:49:12.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 34bf046f-1fd5-4798-a0bd-c6ab04fe8143 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41752024-12-06T20:49:12.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 34bf046f-1fd5-4798-a0bd-c6ab04fe8143 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41762024-12-06T20:49:13.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 830ac5bd-c3e5-433c-bab9-f34a00b9e6cf roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41772024-12-06T20:49:13.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 830ac5bd-c3e5-433c-bab9-f34a00b9e6cf resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41782024-12-06T20:49:13.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 830ac5bd-c3e5-433c-bab9-f34a00b9e6cf response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41792024-12-06T20:49:14.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 88379d4f-e1cc-4918-a33f-402dc4931910 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41802024-12-06T20:49:14.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 88379d4f-e1cc-4918-a33f-402dc4931910 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41812024-12-06T20:49:14.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 88379d4f-e1cc-4918-a33f-402dc4931910 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41822024-12-06T20:49:15.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6eecebb-9f15-4ea8-a1a3-a36a463f1600 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41832024-12-06T20:49:15.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6eecebb-9f15-4ea8-a1a3-a36a463f1600 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41842024-12-06T20:49:15.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6eecebb-9f15-4ea8-a1a3-a36a463f1600 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41852024-12-06T20:49:16.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0eef1bff-8179-4135-b8ae-cbfef0b4f4dd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41862024-12-06T20:49:16.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0eef1bff-8179-4135-b8ae-cbfef0b4f4dd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41872024-12-06T20:49:16.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0eef1bff-8179-4135-b8ae-cbfef0b4f4dd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41882024-12-06T20:49:17.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5c091221-e8fe-477e-a207-6ec7052f3d3b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41892024-12-06T20:49:17.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5c091221-e8fe-477e-a207-6ec7052f3d3b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41902024-12-06T20:49:17.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5c091221-e8fe-477e-a207-6ec7052f3d3b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41912024-12-06T20:49:18.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5ea656cb-394e-47c9-be3b-12d60871078b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41922024-12-06T20:49:18.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5ea656cb-394e-47c9-be3b-12d60871078b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41932024-12-06T20:49:18.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5ea656cb-394e-47c9-be3b-12d60871078b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
41942024-12-06T20:49:18.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
41952024-12-06T20:49:18.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
41962024-12-06T20:49:18.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41972024-12-06T20:49:18.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41982024-12-06T20:49:18.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41992024-12-06T20:49:18.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42002024-12-06T20:49:18.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42012024-12-06T20:49:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42022024-12-06T20:49:18.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42032024-12-06T20:49:18.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42042024-12-06T20:49:18.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42052024-12-06T20:49:18.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42062024-12-06T20:49:18.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42072024-12-06T20:49:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42082024-12-06T20:49:18.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.44241ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42092024-12-06T20:49:18.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42102024-12-06T20:49:18.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
42112024-12-06T20:49:18.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42122024-12-06T20:49:18.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42132024-12-06T20:49:18.903ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
42142024-12-06T20:49:18.903ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.774468ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
42152024-12-06T20:49:19.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 721e0b2a-44ca-40f1-9cf8-accce6244fbe roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42162024-12-06T20:49:19.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 721e0b2a-44ca-40f1-9cf8-accce6244fbe resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42172024-12-06T20:49:19.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 721e0b2a-44ca-40f1-9cf8-accce6244fbe response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42182024-12-06T20:49:20.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = adb65ad7-7917-451e-a8e0-595bbdace12c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42192024-12-06T20:49:20.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = adb65ad7-7917-451e-a8e0-595bbdace12c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42202024-12-06T20:49:20.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1666 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = adb65ad7-7917-451e-a8e0-595bbdace12c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42212024-12-06T20:49:21.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dacac4e8-9169-4d1d-ba98-ded43a373dfb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42222024-12-06T20:49:21.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dacac4e8-9169-4d1d-ba98-ded43a373dfb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42232024-12-06T20:49:21.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dacac4e8-9169-4d1d-ba98-ded43a373dfb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42242024-12-06T20:49:22.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 435 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 89efcf21-bd4f-4d81-ae76-decf45add08d response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
42252024-12-06T20:49:22.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d41fc932-5618-46f0-affb-9831e3c4f5a8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42262024-12-06T20:49:22.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d41fc932-5618-46f0-affb-9831e3c4f5a8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42272024-12-06T20:49:22.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d41fc932-5618-46f0-affb-9831e3c4f5a8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42282024-12-06T20:49:23.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6da1aff-4ca5-46ed-b51e-d16e1f58c2c6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42292024-12-06T20:49:23.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6da1aff-4ca5-46ed-b51e-d16e1f58c2c6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42302024-12-06T20:49:23.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6da1aff-4ca5-46ed-b51e-d16e1f58c2c6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42312024-12-06T20:49:24.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 30eb494d-80ac-4df3-bd02-86101ba111d6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42322024-12-06T20:49:24.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 30eb494d-80ac-4df3-bd02-86101ba111d6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42332024-12-06T20:49:24.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 30eb494d-80ac-4df3-bd02-86101ba111d6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42342024-12-06T20:49:25.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bbc1f97e-c882-4d7b-ba73-25f42ec9c8cd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42352024-12-06T20:49:25.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bbc1f97e-c882-4d7b-ba73-25f42ec9c8cd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42362024-12-06T20:49:25.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bbc1f97e-c882-4d7b-ba73-25f42ec9c8cd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42372024-12-06T20:49:26.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2b2aa8e9-2719-45da-a472-4cea51f6afd0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42382024-12-06T20:49:26.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2b2aa8e9-2719-45da-a472-4cea51f6afd0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42392024-12-06T20:49:26.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2b2aa8e9-2719-45da-a472-4cea51f6afd0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42402024-12-06T20:49:27.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 74800cfc-6712-4523-8afb-6b4642c6e7c9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42412024-12-06T20:49:27.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 74800cfc-6712-4523-8afb-6b4642c6e7c9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42422024-12-06T20:49:27.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 74800cfc-6712-4523-8afb-6b4642c6e7c9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
42432024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
42442024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
42452024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42462024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
42472024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
42482024-12-06T20:49:28.854ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:39:28.854116835 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42492024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42502024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42512024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
42522024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42532024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42542024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
42552024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
42562024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
42572024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
42582024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42592024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42602024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
42612024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42622024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42632024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
42642024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
42652024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
42662024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42672024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42682024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42692024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42702024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
42712024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42722024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42732024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42742024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
42752024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
42762024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42772024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42782024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
42792024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42802024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
42812024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42822024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
42832024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42842024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
42852024-12-06T20:49:28.854ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42862024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42872024-12-06T20:49:28.854ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
42882024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42892024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
42902024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
42912024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42922024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
42932024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42942024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
42952024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
42962024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42972024-12-06T20:49:28.855ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42982024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42992024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
43002024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43012024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
43022024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43032024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
43042024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43052024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
43062024-12-06T20:49:28.855ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
43072024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43082024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43092024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
43102024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
43112024-12-06T20:49:28.855ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
43122024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43132024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.04\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
43142024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43152024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43162024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43172024-12-06T20:49:28.855ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6499, tv_nsec: 193437206 } })
43182024-12-06T20:49:28.855ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6499, tv_nsec: 193440096 } })
43192024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43202024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43212024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43222024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43232024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43242024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43252024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43262024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43272024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43282024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43292024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43302024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43312024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43322024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43332024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43342024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43352024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
43362024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.531639ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
43372024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
43382024-12-06T20:49:28.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.769306ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
43392024-12-06T20:49:28.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43402024-12-06T20:49:28.857ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:39:28.854116835 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43412024-12-06T20:49:28.857ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.07617ms iteration = 6 status = {"expiration":"2024-12-06T20:39:28.854116835Z","pruned":[]}
43422024-12-06T20:49:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43432024-12-06T20:49:28.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43442024-12-06T20:49:28.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43452024-12-06T20:49:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43462024-12-06T20:49:28.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6499, tv_nsec: 196430303 } })
43472024-12-06T20:49:28.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
43482024-12-06T20:49:28.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43492024-12-06T20:49:28.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43502024-12-06T20:49:28.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43512024-12-06T20:49:28.861ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.409186ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43522024-12-06T20:49:28.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.654472ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
43532024-12-06T20:49:28.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43542024-12-06T20:49:28.863ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.503619ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
43552024-12-06T20:49:28.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43562024-12-06T20:49:28.863ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43572024-12-06T20:49:28.863ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43582024-12-06T20:49:28.863ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.196577ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43592024-12-06T20:49:28.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43602024-12-06T20:49:28.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43612024-12-06T20:49:28.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43622024-12-06T20:49:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43632024-12-06T20:49:28.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43642024-12-06T20:49:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43652024-12-06T20:49:28.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43662024-12-06T20:49:28.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43672024-12-06T20:49:28.881ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6499, tv_nsec: 219489398 } })
43682024-12-06T20:49:28.881ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
43692024-12-06T20:49:28.884ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43702024-12-06T20:49:28.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43712024-12-06T20:49:28.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43722024-12-06T20:49:28.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43732024-12-06T20:49:28.893ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6499, tv_nsec: 231948879 } })
43742024-12-06T20:49:28.895ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
43752024-12-06T20:49:28.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43762024-12-06T20:49:28.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43772024-12-06T20:49:28.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43782024-12-06T20:49:28.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43792024-12-06T20:49:28.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43802024-12-06T20:49:28.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
43812024-12-06T20:49:28.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43822024-12-06T20:49:28.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43832024-12-06T20:49:28.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43842024-12-06T20:49:28.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43852024-12-06T20:49:28.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43862024-12-06T20:49:28.930ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43872024-12-06T20:49:28.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.107332ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
43882024-12-06T20:49:28.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43892024-12-06T20:49:28.932ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
43902024-12-06T20:49:28.932ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.719463ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
43912024-12-06T20:49:28.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43922024-12-06T20:49:28.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43932024-12-06T20:49:28.934ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43942024-12-06T20:49:28.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43952024-12-06T20:49:28.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43962024-12-06T20:49:28.936ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43972024-12-06T20:49:28.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43982024-12-06T20:49:28.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43992024-12-06T20:49:28.939ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44002024-12-06T20:49:28.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44012024-12-06T20:49:28.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44022024-12-06T20:49:28.940ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44032024-12-06T20:49:28.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44042024-12-06T20:49:28.941ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44052024-12-06T20:49:28.941ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44062024-12-06T20:49:28.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44072024-12-06T20:49:28.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44082024-12-06T20:49:28.942ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.251679ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44092024-12-06T20:49:28.942ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44102024-12-06T20:49:28.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44112024-12-06T20:49:28.945ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44122024-12-06T20:49:28.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44132024-12-06T20:49:28.948ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44142024-12-06T20:49:28.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44152024-12-06T20:49:28.949ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44162024-12-06T20:49:28.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44172024-12-06T20:49:28.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a5996f2b-1532-4465-831c-5365301d5007 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
44182024-12-06T20:49:28.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a5996f2b-1532-4465-831c-5365301d5007 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
44192024-12-06T20:49:28.951ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44202024-12-06T20:49:28.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44212024-12-06T20:49:28.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44222024-12-06T20:49:28.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44232024-12-06T20:49:28.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a5996f2b-1532-4465-831c-5365301d5007 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
44242024-12-06T20:49:28.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44252024-12-06T20:49:28.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262024-12-06T20:49:28.957ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44272024-12-06T20:49:28.957ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44282024-12-06T20:49:28.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44292024-12-06T20:49:28.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44302024-12-06T20:49:28.960ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44312024-12-06T20:49:28.961ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44322024-12-06T20:49:28.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44332024-12-06T20:49:28.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44342024-12-06T20:49:28.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44352024-12-06T20:49:28.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44362024-12-06T20:49:28.965ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44372024-12-06T20:49:28.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44382024-12-06T20:49:28.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44392024-12-06T20:49:28.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44402024-12-06T20:49:28.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44412024-12-06T20:49:28.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44422024-12-06T20:49:28.980ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44432024-12-06T20:49:28.993ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44442024-12-06T20:49:28.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44452024-12-06T20:49:28.994ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44462024-12-06T20:49:28.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44472024-12-06T20:49:28.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44482024-12-06T20:49:28.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44492024-12-06T20:49:29.001ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44502024-12-06T20:49:29.001ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44512024-12-06T20:49:29.001ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 146.674711ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44522024-12-06T20:49:29.003ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44532024-12-06T20:49:29.003ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44542024-12-06T20:49:29.003ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44552024-12-06T20:49:29.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44562024-12-06T20:49:29.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44572024-12-06T20:49:29.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44582024-12-06T20:49:29.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44592024-12-06T20:49:29.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44602024-12-06T20:49:29.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44612024-12-06T20:49:29.014ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44622024-12-06T20:49:29.014ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44632024-12-06T20:49:29.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44642024-12-06T20:49:29.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44652024-12-06T20:49:29.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44662024-12-06T20:49:29.014ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44672024-12-06T20:49:29.014ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 160.029605ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44682024-12-06T20:49:29.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44692024-12-06T20:49:29.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44702024-12-06T20:49:29.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
44712024-12-06T20:49:29.015ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44722024-12-06T20:49:29.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44732024-12-06T20:49:29.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 162.275304ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44742024-12-06T20:49:29.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44752024-12-06T20:49:29.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44762024-12-06T20:49:29.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44772024-12-06T20:49:29.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44782024-12-06T20:49:29.020ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44792024-12-06T20:49:29.020ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44802024-12-06T20:49:29.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44812024-12-06T20:49:29.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44822024-12-06T20:49:29.023ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44832024-12-06T20:49:29.023ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 168.565855ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44842024-12-06T20:49:29.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44852024-12-06T20:49:29.023ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44862024-12-06T20:49:29.023ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44872024-12-06T20:49:29.023ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44882024-12-06T20:49:29.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44892024-12-06T20:49:29.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44902024-12-06T20:49:29.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44912024-12-06T20:49:29.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44922024-12-06T20:49:29.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44932024-12-06T20:49:29.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44942024-12-06T20:49:29.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44952024-12-06T20:49:29.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44962024-12-06T20:49:29.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44972024-12-06T20:49:29.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
44982024-12-06T20:49:29.032ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44992024-12-06T20:49:29.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45002024-12-06T20:49:29.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45012024-12-06T20:49:29.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45022024-12-06T20:49:29.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45032024-12-06T20:49:29.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45042024-12-06T20:49:29.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45052024-12-06T20:49:29.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45062024-12-06T20:49:29.037ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
45072024-12-06T20:49:29.037ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
45082024-12-06T20:49:29.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45092024-12-06T20:49:29.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45102024-12-06T20:49:29.038ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45112024-12-06T20:49:29.038ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45122024-12-06T20:49:29.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45132024-12-06T20:49:29.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45142024-12-06T20:49:29.038ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45152024-12-06T20:49:29.038ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45162024-12-06T20:49:29.038ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "07e5f807-ff41-49e6-9a63-a364fa7e4a05", "content-length": "26", "date": "Fri, 06 Dec 2024 20:49:28 GMT"} })
45172024-12-06T20:49:29.038ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45182024-12-06T20:49:29.040ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45192024-12-06T20:49:29.040ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45202024-12-06T20:49:29.040ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
45212024-12-06T20:49:29.040ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 186.411996ms iteration = 6 status = {"generation":1}
45222024-12-06T20:49:29.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45232024-12-06T20:49:29.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45242024-12-06T20:49:29.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45252024-12-06T20:49:29.043ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45262024-12-06T20:49:29.044ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272024-12-06T20:49:29.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 189.67073ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45282024-12-06T20:49:29.045ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
45292024-12-06T20:49:29.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45302024-12-06T20:49:29.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45312024-12-06T20:49:29.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45322024-12-06T20:49:29.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45332024-12-06T20:49:29.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45342024-12-06T20:49:29.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45352024-12-06T20:49:29.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45362024-12-06T20:49:29.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45372024-12-06T20:49:29.047ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
45382024-12-06T20:49:29.047ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45392024-12-06T20:49:29.047ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
45402024-12-06T20:49:29.047ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 193.368315ms iteration = 6 status = {"generation":2}
45412024-12-06T20:49:29.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45422024-12-06T20:49:29.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45432024-12-06T20:49:29.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45442024-12-06T20:49:29.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
45452024-12-06T20:49:29.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45462024-12-06T20:49:29.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45472024-12-06T20:49:29.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45482024-12-06T20:49:29.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45492024-12-06T20:49:29.056ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 201.963887ms iteration = 11 status = 0
45502024-12-06T20:49:29.058ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45512024-12-06T20:49:29.058ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45522024-12-06T20:49:29.058ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1383f59b-1e63-483e-a751-2127dfabf373", "content-length": "26", "date": "Fri, 06 Dec 2024 20:49:28 GMT"} })
45532024-12-06T20:49:29.058ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45542024-12-06T20:49:29.060ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45552024-12-06T20:49:29.063ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
45562024-12-06T20:49:29.063ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45572024-12-06T20:49:29.063ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4393ce4-6f81-4fdb-9c94-dc2077ea9777", "content-length": "26", "date": "Fri, 06 Dec 2024 20:49:28 GMT"} })
45582024-12-06T20:49:29.063ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45592024-12-06T20:49:29.065ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45602024-12-06T20:49:29.065ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45612024-12-06T20:49:29.065ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 210.376404ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45622024-12-06T20:49:29.065ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
45632024-12-06T20:49:29.080ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 225.858502ms iteration = 13 status = {"physical_disks_added":0}
45642024-12-06T20:49:29.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45652024-12-06T20:49:29.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45662024-12-06T20:49:29.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45672024-12-06T20:49:29.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45682024-12-06T20:49:29.104ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) }
45692024-12-06T20:49:29.104ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 250.380765ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
45702024-12-06T20:49:29.140ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
45712024-12-06T20:49:29.140ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 285.12798ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
45722024-12-06T20:49:29.159ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45732024-12-06T20:49:29.202ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45742024-12-06T20:49:29.203ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c4fe024-a47d-4b58-99de-b20f3c2e6d8a", "content-length": "1", "date": "Fri, 06 Dec 2024 20:49:28 GMT"} })
45752024-12-06T20:49:29.204ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45762024-12-06T20:49:29.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45772024-12-06T20:49:29.207ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
45782024-12-06T20:49:29.207ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6d5c72ce-11bd-4c63-97d7-7b97269f9b28", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45792024-12-06T20:49:29.207ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45802024-12-06T20:49:29.208ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7911fbc7-dbf8-4706-acb3-f0bb8fc1a182", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45812024-12-06T20:49:29.208ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45822024-12-06T20:49:29.210ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45832024-12-06T20:49:29.210ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 356.285095ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45842024-12-06T20:49:29.301ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45852024-12-06T20:49:29.302ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f4a6a378-f18d-4cb9-a628-2ad17ede31ca", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45862024-12-06T20:49:29.302ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45872024-12-06T20:49:29.304ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "dc11a742-3ef7-4415-8c38-11f97cdb3a0b", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45882024-12-06T20:49:29.304ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45892024-12-06T20:49:29.305ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6629b067-ea48-4e50-8288-9d4893d86d83", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45902024-12-06T20:49:29.305ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45912024-12-06T20:49:29.307ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45922024-12-06T20:49:29.307ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 453.230494ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45932024-12-06T20:49:29.322ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 467.40239ms iteration = 11 status = {}
45942024-12-06T20:49:29.326ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45952024-12-06T20:49:29.326ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45962024-12-06T20:49:29.327ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "76a52a3b-9402-4871-874f-cc130aab3fe5", "content-length": "372", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} })
45972024-12-06T20:49:29.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45982024-12-06T20:49:29.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45992024-12-06T20:49:29.328ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46002024-12-06T20:49:29.328ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46012024-12-06T20:49:29.329ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 475.56922ms iteration = 11 status = null
46022024-12-06T20:49:29.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46032024-12-06T20:49:29.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46042024-12-06T20:49:29.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46052024-12-06T20:49:29.332ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46062024-12-06T20:49:29.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
46072024-12-06T20:49:29.334ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46082024-12-06T20:49:29.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46092024-12-06T20:49:29.334ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46102024-12-06T20:49:29.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46112024-12-06T20:49:29.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46122024-12-06T20:49:29.337ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46132024-12-06T20:49:29.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46142024-12-06T20:49:29.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46152024-12-06T20:49:29.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46162024-12-06T20:49:29.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46172024-12-06T20:49:29.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46182024-12-06T20:49:29.346ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46192024-12-06T20:49:29.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46202024-12-06T20:49:29.348ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46212024-12-06T20:49:29.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46222024-12-06T20:49:29.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46232024-12-06T20:49:29.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46242024-12-06T20:49:29.375ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46252024-12-06T20:49:29.376ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "710f9719-4590-45b0-8d91-cce92743b2f1", "content-length": "691", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} })
46262024-12-06T20:49:29.376ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46272024-12-06T20:49:29.376ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46282024-12-06T20:49:29.376ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46292024-12-06T20:49:29.377ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 522.334886ms iteration = 11 status = {}
46302024-12-06T20:49:29.377ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46312024-12-06T20:49:29.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46322024-12-06T20:49:29.377ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
46332024-12-06T20:49:29.378ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46342024-12-06T20:49:29.378ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1a0291db-7546-4fa4-adc3-ea1743f5b369", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} })
46352024-12-06T20:49:29.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46362024-12-06T20:49:29.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46372024-12-06T20:49:29.378ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
46382024-12-06T20:49:29.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46392024-12-06T20:49:29.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46402024-12-06T20:49:29.379ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46412024-12-06T20:49:29.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46422024-12-06T20:49:29.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46432024-12-06T20:49:29.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46442024-12-06T20:49:29.383ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
46452024-12-06T20:49:29.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46462024-12-06T20:49:29.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46472024-12-06T20:49:29.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46482024-12-06T20:49:29.386ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46492024-12-06T20:49:29.386ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46502024-12-06T20:49:29.386ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "afeec47d-d1fb-4c94-91bb-1f669ceb2ed3", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} })
46512024-12-06T20:49:29.388ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 533.395691ms iteration = 11 status = {}
46522024-12-06T20:49:29.389ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46532024-12-06T20:49:29.390ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "74ccbf6e-559f-423e-9034-103a056dc161", "content-length": "134", "date": "Fri, 06 Dec 2024 20:49:28 GMT"} })
46542024-12-06T20:49:29.390ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46552024-12-06T20:49:29.390ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
46562024-12-06T20:49:29.390ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46572024-12-06T20:49:29.390ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46582024-12-06T20:49:29.390ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46592024-12-06T20:49:29.390ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46602024-12-06T20:49:29.390ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46612024-12-06T20:49:29.390ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46622024-12-06T20:49:29.390ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46632024-12-06T20:49:29.390ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46642024-12-06T20:49:29.390ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
46652024-12-06T20:49:29.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46662024-12-06T20:49:29.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46672024-12-06T20:49:29.392ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46682024-12-06T20:49:29.392ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "97971e23-80e4-415f-925c-20511d00cbd1", "content-length": "2", "date": "Fri, 06 Dec 2024 20:49:28 GMT"} })
46692024-12-06T20:49:29.392ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46702024-12-06T20:49:29.392ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "26412dca-88ee-4b7b-8527-accbcd1f252d", "content-length": "52", "date": "Fri, 06 Dec 2024 20:49:28 GMT"} })
46712024-12-06T20:49:29.392ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
46722024-12-06T20:49:29.392ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46732024-12-06T20:49:29.413ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46742024-12-06T20:49:29.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46752024-12-06T20:49:29.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46762024-12-06T20:49:29.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46772024-12-06T20:49:29.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46782024-12-06T20:49:29.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
46792024-12-06T20:49:29.422ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46802024-12-06T20:49:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46812024-12-06T20:49:29.431ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46822024-12-06T20:49:29.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46832024-12-06T20:49:29.433ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46842024-12-06T20:49:29.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46852024-12-06T20:49:29.435ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46862024-12-06T20:49:29.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46872024-12-06T20:49:29.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46882024-12-06T20:49:29.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46892024-12-06T20:49:29.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46902024-12-06T20:49:29.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46912024-12-06T20:49:29.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46922024-12-06T20:49:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46932024-12-06T20:49:29.445ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46942024-12-06T20:49:29.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46952024-12-06T20:49:29.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46962024-12-06T20:49:29.450ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
46972024-12-06T20:49:29.450ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46982024-12-06T20:49:29.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46992024-12-06T20:49:29.452ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47002024-12-06T20:49:29.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47012024-12-06T20:49:29.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47022024-12-06T20:49:29.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47032024-12-06T20:49:29.455ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47042024-12-06T20:49:29.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
47052024-12-06T20:49:29.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47062024-12-06T20:49:29.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47072024-12-06T20:49:29.465ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
47082024-12-06T20:49:29.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47092024-12-06T20:49:29.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47102024-12-06T20:49:29.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47112024-12-06T20:49:29.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
47122024-12-06T20:49:29.468ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47132024-12-06T20:49:29.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47142024-12-06T20:49:29.469ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
47152024-12-06T20:49:29.469ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
47162024-12-06T20:49:29.469ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
47172024-12-06T20:49:29.499ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f9c5ba49-acae-4674-92ac-7fb9005cc0fb", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} })
47182024-12-06T20:49:29.499ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
47192024-12-06T20:49:29.499ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47202024-12-06T20:49:29.499ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0f9cd36-6de8-48ff-88d6-ba3893132429", "content-length": "682", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} })
47212024-12-06T20:49:29.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47222024-12-06T20:49:29.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47232024-12-06T20:49:29.503ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47242024-12-06T20:49:29.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47252024-12-06T20:49:29.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47262024-12-06T20:49:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47272024-12-06T20:49:29.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47282024-12-06T20:49:29.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47292024-12-06T20:49:29.516ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 661.568495ms iteration = 11 status = {}
47302024-12-06T20:49:29.597ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 0a667526-2006-419e-9b68-c251fd138c06, time_created: 2024-12-06T20:44:28.288040Z, time_modified: 2024-12-06T20:44:28.288040Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
47312024-12-06T20:49:29.597ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
47322024-12-06T20:49:29.597ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47332024-12-06T20:49:29.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47342024-12-06T20:49:29.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47352024-12-06T20:49:29.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47362024-12-06T20:49:29.602ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47372024-12-06T20:49:29.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
47382024-12-06T20:49:29.635ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
47392024-12-06T20:49:29.635ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "db24394d-0d78-4e35-b082-8453fea5da3b", "date": "Fri, 06 Dec 2024 20:49:29 GMT"} })
47402024-12-06T20:49:29.636ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
47412024-12-06T20:49:29.636ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 781.377173ms
47422024-12-06T20:49:29.636ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 781.385785ms iteration = 2 status = {}
47432024-12-06T20:49:29.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 64570034-77b5-428b-bd81-b6548c37548a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47442024-12-06T20:49:29.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 64570034-77b5-428b-bd81-b6548c37548a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47452024-12-06T20:49:29.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 64570034-77b5-428b-bd81-b6548c37548a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47462024-12-06T20:49:31.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d123bfd4-c85d-45de-b541-10688859a52a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47472024-12-06T20:49:31.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d123bfd4-c85d-45de-b541-10688859a52a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47482024-12-06T20:49:31.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d123bfd4-c85d-45de-b541-10688859a52a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47492024-12-06T20:49:32.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e1a36bf2-7f15-49be-bc27-9b59cd10e7a4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47502024-12-06T20:49:32.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e1a36bf2-7f15-49be-bc27-9b59cd10e7a4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47512024-12-06T20:49:32.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e1a36bf2-7f15-49be-bc27-9b59cd10e7a4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47522024-12-06T20:49:32.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 463 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 232641ec-fe17-40fe-a879-2349099a937e response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
47532024-12-06T20:49:33.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81524885-b25f-48a1-b3c8-b0d99b111083 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47542024-12-06T20:49:33.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81524885-b25f-48a1-b3c8-b0d99b111083 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47552024-12-06T20:49:33.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81524885-b25f-48a1-b3c8-b0d99b111083 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47562024-12-06T20:49:34.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 906367b3-74eb-42bd-998d-ac83d87caffc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47572024-12-06T20:49:34.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 906367b3-74eb-42bd-998d-ac83d87caffc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47582024-12-06T20:49:34.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 906367b3-74eb-42bd-998d-ac83d87caffc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47592024-12-06T20:49:35.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13944de2-1ac2-41e3-9072-31207d110b61 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47602024-12-06T20:49:35.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13944de2-1ac2-41e3-9072-31207d110b61 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47612024-12-06T20:49:35.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13944de2-1ac2-41e3-9072-31207d110b61 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47622024-12-06T20:49:36.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9973d8e9-a52a-4572-932f-e4ea546f48ce roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47632024-12-06T20:49:36.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9973d8e9-a52a-4572-932f-e4ea546f48ce resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47642024-12-06T20:49:36.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9973d8e9-a52a-4572-932f-e4ea546f48ce response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47652024-12-06T20:49:37.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a28fe03d-1488-46f8-aafd-490eed63784e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47662024-12-06T20:49:37.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a28fe03d-1488-46f8-aafd-490eed63784e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47672024-12-06T20:49:37.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a28fe03d-1488-46f8-aafd-490eed63784e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47682024-12-06T20:49:38.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6770da59-d521-4a30-b578-92001b1c306e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47692024-12-06T20:49:38.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6770da59-d521-4a30-b578-92001b1c306e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47702024-12-06T20:49:38.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6770da59-d521-4a30-b578-92001b1c306e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47712024-12-06T20:49:38.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
47722024-12-06T20:49:38.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
47732024-12-06T20:49:38.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47742024-12-06T20:49:38.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47752024-12-06T20:49:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47762024-12-06T20:49:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47772024-12-06T20:49:38.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47782024-12-06T20:49:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47792024-12-06T20:49:38.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47802024-12-06T20:49:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47812024-12-06T20:49:38.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47822024-12-06T20:49:38.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47832024-12-06T20:49:38.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47842024-12-06T20:49:38.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
47852024-12-06T20:49:38.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47862024-12-06T20:49:38.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47872024-12-06T20:49:38.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
47882024-12-06T20:49:38.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.023938ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
47892024-12-06T20:49:38.884ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47902024-12-06T20:49:38.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47912024-12-06T20:49:38.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.478066ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47922024-12-06T20:49:39.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8faf3eca-0c51-46ca-a042-0bde2ce1c971 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47932024-12-06T20:49:39.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8faf3eca-0c51-46ca-a042-0bde2ce1c971 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47942024-12-06T20:49:39.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8faf3eca-0c51-46ca-a042-0bde2ce1c971 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47952024-12-06T20:49:40.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 353b003a-fbdc-4da2-ac36-6d80f253db17 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47962024-12-06T20:49:40.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 353b003a-fbdc-4da2-ac36-6d80f253db17 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47972024-12-06T20:49:40.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 353b003a-fbdc-4da2-ac36-6d80f253db17 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47982024-12-06T20:49:41.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 34952d60-4df8-4dea-8e74-5289180049ef roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
47992024-12-06T20:49:41.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 34952d60-4df8-4dea-8e74-5289180049ef resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48002024-12-06T20:49:41.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 34952d60-4df8-4dea-8e74-5289180049ef response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48012024-12-06T20:49:42.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eda8bd68-5bbf-4d55-b1dc-52e566da7591 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48022024-12-06T20:49:42.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eda8bd68-5bbf-4d55-b1dc-52e566da7591 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48032024-12-06T20:49:42.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eda8bd68-5bbf-4d55-b1dc-52e566da7591 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48042024-12-06T20:49:42.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 436 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 02c936a0-9ec0-4db4-bcea-3d498a3d970c response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
48052024-12-06T20:49:43.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc11bf25-7a9a-45b6-90d4-9d3fbac49b40 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48062024-12-06T20:49:43.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc11bf25-7a9a-45b6-90d4-9d3fbac49b40 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48072024-12-06T20:49:43.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc11bf25-7a9a-45b6-90d4-9d3fbac49b40 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48082024-12-06T20:49:44.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 25c30e41-eaa3-4a3d-b3e6-67aa0b44b2ac roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48092024-12-06T20:49:44.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 25c30e41-eaa3-4a3d-b3e6-67aa0b44b2ac resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48102024-12-06T20:49:44.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 25c30e41-eaa3-4a3d-b3e6-67aa0b44b2ac response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48112024-12-06T20:49:45.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc13cca5-af09-4641-bcbc-fdd9a8dbd6ab roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48122024-12-06T20:49:45.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc13cca5-af09-4641-bcbc-fdd9a8dbd6ab resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48132024-12-06T20:49:45.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc13cca5-af09-4641-bcbc-fdd9a8dbd6ab response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48142024-12-06T20:49:46.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 84667a97-daa8-4e4c-a1db-3a566e346f25 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48152024-12-06T20:49:46.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 84667a97-daa8-4e4c-a1db-3a566e346f25 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48162024-12-06T20:49:46.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 84667a97-daa8-4e4c-a1db-3a566e346f25 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48172024-12-06T20:49:47.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6059406e-8a82-4b94-a6be-49bfb74bcadb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48182024-12-06T20:49:47.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6059406e-8a82-4b94-a6be-49bfb74bcadb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48192024-12-06T20:49:47.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6059406e-8a82-4b94-a6be-49bfb74bcadb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48202024-12-06T20:49:48.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6b98852a-0308-4f1f-91f5-133f36ec6805 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48212024-12-06T20:49:48.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6b98852a-0308-4f1f-91f5-133f36ec6805 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48222024-12-06T20:49:48.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6b98852a-0308-4f1f-91f5-133f36ec6805 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48232024-12-06T20:49:48.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
48242024-12-06T20:49:48.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
48252024-12-06T20:49:48.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48262024-12-06T20:49:48.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48272024-12-06T20:49:48.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48282024-12-06T20:49:48.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48292024-12-06T20:49:48.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48302024-12-06T20:49:48.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48312024-12-06T20:49:48.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48322024-12-06T20:49:48.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.134851ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48332024-12-06T20:49:48.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48342024-12-06T20:49:48.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48352024-12-06T20:49:48.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48362024-12-06T20:49:48.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48372024-12-06T20:49:48.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48382024-12-06T20:49:48.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48392024-12-06T20:49:48.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
48402024-12-06T20:49:48.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48412024-12-06T20:49:48.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48422024-12-06T20:49:48.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
48432024-12-06T20:49:48.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.157279ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
48442024-12-06T20:49:49.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4cf96f66-fa6b-4542-8709-4b991d47e89b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48452024-12-06T20:49:49.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4cf96f66-fa6b-4542-8709-4b991d47e89b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48462024-12-06T20:49:49.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4cf96f66-fa6b-4542-8709-4b991d47e89b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48472024-12-06T20:49:50.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75badd27-c496-457e-993b-1f065dd030d1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48482024-12-06T20:49:50.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75badd27-c496-457e-993b-1f065dd030d1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48492024-12-06T20:49:50.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75badd27-c496-457e-993b-1f065dd030d1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48502024-12-06T20:49:51.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d36e8227-641d-4039-86dd-1572c34275c4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48512024-12-06T20:49:51.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d36e8227-641d-4039-86dd-1572c34275c4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48522024-12-06T20:49:51.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d36e8227-641d-4039-86dd-1572c34275c4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48532024-12-06T20:49:52.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 439 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = ff9d4c37-66bf-45f9-b611-c65339a833a8 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
48542024-12-06T20:49:52.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8809a896-37e1-4707-bd2a-5fc111a8b9f9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48552024-12-06T20:49:52.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8809a896-37e1-4707-bd2a-5fc111a8b9f9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48562024-12-06T20:49:52.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8809a896-37e1-4707-bd2a-5fc111a8b9f9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48572024-12-06T20:49:53.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d200971f-38a9-4c40-a13f-e8294a6c1773 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48582024-12-06T20:49:53.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d200971f-38a9-4c40-a13f-e8294a6c1773 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48592024-12-06T20:49:53.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d200971f-38a9-4c40-a13f-e8294a6c1773 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48602024-12-06T20:49:54.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = af989cec-f115-492b-91ad-4d240cc5f7c2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48612024-12-06T20:49:54.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = af989cec-f115-492b-91ad-4d240cc5f7c2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48622024-12-06T20:49:54.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = af989cec-f115-492b-91ad-4d240cc5f7c2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48632024-12-06T20:49:55.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a56372bf-325f-458d-bbe2-79199554ed48 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48642024-12-06T20:49:55.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a56372bf-325f-458d-bbe2-79199554ed48 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48652024-12-06T20:49:55.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a56372bf-325f-458d-bbe2-79199554ed48 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48662024-12-06T20:49:56.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 12f4f6bf-4982-4816-8eba-adcb504a8af4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48672024-12-06T20:49:56.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 12f4f6bf-4982-4816-8eba-adcb504a8af4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48682024-12-06T20:49:56.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 12f4f6bf-4982-4816-8eba-adcb504a8af4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48692024-12-06T20:49:57.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81084beb-0078-4ce7-9f79-5fdb05f5f94e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48702024-12-06T20:49:57.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81084beb-0078-4ce7-9f79-5fdb05f5f94e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48712024-12-06T20:49:57.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 81084beb-0078-4ce7-9f79-5fdb05f5f94e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48722024-12-06T20:49:58.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 104e1528-a593-4b0a-88e5-adc49361f3ba roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48732024-12-06T20:49:58.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 104e1528-a593-4b0a-88e5-adc49361f3ba resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48742024-12-06T20:49:58.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 104e1528-a593-4b0a-88e5-adc49361f3ba response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
48752024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
48762024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48772024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48782024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
48792024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48802024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
48812024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48822024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
48832024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
48842024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48852024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48862024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
48872024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
48882024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48892024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48902024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
48912024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48922024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
48932024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
48942024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48952024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48962024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
48972024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48982024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
48992024-12-06T20:49:58.854ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49002024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49012024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
49022024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49032024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49042024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
49052024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
49062024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
49072024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49082024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49092024-12-06T20:49:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
49102024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49112024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49122024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49132024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49142024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49152024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49162024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49172024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49182024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49192024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49202024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49212024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49222024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49232024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49242024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49252024-12-06T20:49:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49262024-12-06T20:49:58.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6529, tv_nsec: 196966307 } })
49272024-12-06T20:49:58.859ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
49282024-12-06T20:49:58.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.26128ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49292024-12-06T20:49:58.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49302024-12-06T20:49:58.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49312024-12-06T20:49:58.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49322024-12-06T20:49:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49332024-12-06T20:49:58.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6529, tv_nsec: 200038726 } })
49342024-12-06T20:49:58.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
49352024-12-06T20:49:58.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49362024-12-06T20:49:58.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49372024-12-06T20:49:58.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49382024-12-06T20:49:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49392024-12-06T20:49:58.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49402024-12-06T20:49:58.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49412024-12-06T20:49:58.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.142269ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
49422024-12-06T20:49:58.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49432024-12-06T20:49:58.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49442024-12-06T20:49:58.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49452024-12-06T20:49:58.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49462024-12-06T20:49:58.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49472024-12-06T20:49:58.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49482024-12-06T20:49:58.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49492024-12-06T20:49:58.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49502024-12-06T20:49:58.884ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6529, tv_nsec: 222749072 } })
49512024-12-06T20:49:58.884ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
49522024-12-06T20:49:58.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49532024-12-06T20:49:58.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49542024-12-06T20:49:58.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.48166ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
49552024-12-06T20:49:58.915ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49562024-12-06T20:49:58.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49572024-12-06T20:49:58.917ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
49582024-12-06T20:49:58.917ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49592024-12-06T20:49:58.917ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69dc9395-4ae9-4963-ba40-755bd505e807", "content-length": "26", "date": "Fri, 06 Dec 2024 20:49:58 GMT"} })
49602024-12-06T20:49:58.917ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49612024-12-06T20:49:58.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49622024-12-06T20:49:58.917ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49632024-12-06T20:49:58.917ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49642024-12-06T20:49:58.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49652024-12-06T20:49:58.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49662024-12-06T20:49:58.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49672024-12-06T20:49:58.919ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49682024-12-06T20:49:58.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49692024-12-06T20:49:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49702024-12-06T20:49:58.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49712024-12-06T20:49:58.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49722024-12-06T20:49:58.920ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49732024-12-06T20:49:58.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49742024-12-06T20:49:58.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49752024-12-06T20:49:58.921ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49762024-12-06T20:49:58.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49772024-12-06T20:49:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49782024-12-06T20:49:58.924ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49792024-12-06T20:49:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49802024-12-06T20:49:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49812024-12-06T20:49:58.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49822024-12-06T20:49:58.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49832024-12-06T20:49:58.924ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49842024-12-06T20:49:58.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49852024-12-06T20:49:58.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49862024-12-06T20:49:58.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49872024-12-06T20:49:58.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
49882024-12-06T20:49:58.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49892024-12-06T20:49:58.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.062952ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49902024-12-06T20:49:58.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49912024-12-06T20:49:58.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49922024-12-06T20:49:58.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49932024-12-06T20:49:58.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49942024-12-06T20:49:58.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
49952024-12-06T20:49:58.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49962024-12-06T20:49:58.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49972024-12-06T20:49:58.929ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49982024-12-06T20:49:58.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49992024-12-06T20:49:58.930ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.698102ms iteration = 12 status = 0
50002024-12-06T20:49:58.931ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50012024-12-06T20:49:58.931ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50022024-12-06T20:49:58.932ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a34b8d1f-4711-4f16-9c30-cba5af33a180", "content-length": "26", "date": "Fri, 06 Dec 2024 20:49:58 GMT"} })
50032024-12-06T20:49:58.932ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50042024-12-06T20:49:58.934ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50052024-12-06T20:49:58.947ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
50062024-12-06T20:49:58.947ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.581667ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
50072024-12-06T20:49:58.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.337483ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50082024-12-06T20:49:58.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.606032ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50092024-12-06T20:49:58.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50102024-12-06T20:49:58.967ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50112024-12-06T20:49:58.967ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50122024-12-06T20:49:58.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50132024-12-06T20:49:58.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50142024-12-06T20:49:58.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50152024-12-06T20:49:58.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50162024-12-06T20:49:58.969ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50172024-12-06T20:49:58.969ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 114.803869ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50182024-12-06T20:49:58.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50192024-12-06T20:49:58.970ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50202024-12-06T20:49:58.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 115.919348ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50212024-12-06T20:49:58.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50222024-12-06T20:49:58.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50232024-12-06T20:49:58.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50242024-12-06T20:49:58.984ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
50252024-12-06T20:49:58.984ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50262024-12-06T20:49:58.984ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3738df75-0d5d-4575-bb97-d3d6045fea04", "content-length": "26", "date": "Fri, 06 Dec 2024 20:49:58 GMT"} })
50272024-12-06T20:49:58.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50282024-12-06T20:49:58.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
50292024-12-06T20:49:59.016ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50302024-12-06T20:49:59.016ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50312024-12-06T20:49:59.016ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 161.7602ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50322024-12-06T20:49:59.028ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 173.277398ms iteration = 14 status = {"physical_disks_added":0}
50332024-12-06T20:49:59.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50342024-12-06T20:49:59.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50352024-12-06T20:49:59.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50362024-12-06T20:49:59.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50372024-12-06T20:49:59.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50382024-12-06T20:49:59.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50392024-12-06T20:49:59.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50402024-12-06T20:49:59.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50412024-12-06T20:49:59.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50422024-12-06T20:49:59.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50432024-12-06T20:49:59.189ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50442024-12-06T20:49:59.190ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50452024-12-06T20:49:59.221ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50462024-12-06T20:49:59.222ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5f9e07e-ebcc-4957-8fe8-f2472ea2cc90", "content-length": "1", "date": "Fri, 06 Dec 2024 20:49:58 GMT"} })
50472024-12-06T20:49:59.222ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50482024-12-06T20:49:59.223ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50492024-12-06T20:49:59.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50502024-12-06T20:49:59.225ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 371.868887ms iteration = 12 status = null
50512024-12-06T20:49:59.229ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 374.655079ms iteration = 12 status = {}
50522024-12-06T20:49:59.234ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a4be482-84dc-4460-9933-4fdcbf2a0a5e", "content-length": "691", "date": "Fri, 06 Dec 2024 20:49:58 GMT"} })
50532024-12-06T20:49:59.234ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
50542024-12-06T20:49:59.234ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
50552024-12-06T20:49:59.234ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
50562024-12-06T20:49:59.234ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c83523f5-5364-4050-89d7-a1bcc021d808", "content-length": "372", "date": "Fri, 06 Dec 2024 20:49:59 GMT"} })
50572024-12-06T20:49:59.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50582024-12-06T20:49:59.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50592024-12-06T20:49:59.236ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 381.121366ms iteration = 12 status = {}
50602024-12-06T20:49:59.280ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
50612024-12-06T20:49:59.280ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50622024-12-06T20:49:59.281ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "785fae12-bb74-44fc-ab2b-28d917defce4", "date": "Fri, 06 Dec 2024 20:49:59 GMT"} })
50632024-12-06T20:49:59.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50642024-12-06T20:49:59.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50652024-12-06T20:49:59.283ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50662024-12-06T20:49:59.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50672024-12-06T20:49:59.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50682024-12-06T20:49:59.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50692024-12-06T20:49:59.290ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50702024-12-06T20:49:59.290ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50712024-12-06T20:49:59.290ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f640dc63-0ac7-4e44-9ccf-f467d1b655ba", "date": "Fri, 06 Dec 2024 20:49:59 GMT"} })
50722024-12-06T20:49:59.292ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 438.031182ms iteration = 12 status = {}
50732024-12-06T20:49:59.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50742024-12-06T20:49:59.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50752024-12-06T20:49:59.302ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
50762024-12-06T20:49:59.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50772024-12-06T20:49:59.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50782024-12-06T20:49:59.312ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50792024-12-06T20:49:59.312ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "46bcaa73-6458-4689-9354-40a65578ba55", "content-length": "134", "date": "Fri, 06 Dec 2024 20:49:58 GMT"} })
50802024-12-06T20:49:59.312ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50812024-12-06T20:49:59.312ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
50822024-12-06T20:49:59.312ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50832024-12-06T20:49:59.312ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50842024-12-06T20:49:59.312ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50852024-12-06T20:49:59.312ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50862024-12-06T20:49:59.312ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50872024-12-06T20:49:59.312ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50882024-12-06T20:49:59.312ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50892024-12-06T20:49:59.312ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50902024-12-06T20:49:59.313ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
50912024-12-06T20:49:59.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50922024-12-06T20:49:59.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50932024-12-06T20:49:59.315ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50942024-12-06T20:49:59.315ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6355bf08-0411-4fa3-8b3c-2c7064b07159", "content-length": "2", "date": "Fri, 06 Dec 2024 20:49:58 GMT"} })
50952024-12-06T20:49:59.315ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50962024-12-06T20:49:59.315ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcb1bb7e-7c41-4c8b-b2e4-ddd60594d066", "content-length": "52", "date": "Fri, 06 Dec 2024 20:49:58 GMT"} })
50972024-12-06T20:49:59.315ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
50982024-12-06T20:49:59.315ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50992024-12-06T20:49:59.412ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8713d941-125b-4ffa-84b2-5e767b20e93e", "date": "Fri, 06 Dec 2024 20:49:59 GMT"} })
51002024-12-06T20:49:59.413ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
51012024-12-06T20:49:59.413ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51022024-12-06T20:49:59.413ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8aac371-400d-4c18-82ca-8e51066d8d3c", "content-length": "682", "date": "Fri, 06 Dec 2024 20:49:59 GMT"} })
51032024-12-06T20:49:59.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51042024-12-06T20:49:59.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51052024-12-06T20:49:59.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51062024-12-06T20:49:59.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51072024-12-06T20:49:59.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51082024-12-06T20:49:59.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51092024-12-06T20:49:59.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51102024-12-06T20:49:59.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51112024-12-06T20:49:59.429ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 574.195413ms iteration = 12 status = {}
51122024-12-06T20:49:59.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 07993ed7-127d-43e9-8bf5-bc9d50c159a8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51132024-12-06T20:49:59.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 07993ed7-127d-43e9-8bf5-bc9d50c159a8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51142024-12-06T20:49:59.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 07993ed7-127d-43e9-8bf5-bc9d50c159a8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51152024-12-06T20:50:00.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 938c317e-3046-4525-89a5-563c24796840 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51162024-12-06T20:50:00.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 938c317e-3046-4525-89a5-563c24796840 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51172024-12-06T20:50:00.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 938c317e-3046-4525-89a5-563c24796840 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51182024-12-06T20:50:01.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d9623f04-cb07-4851-8071-10725875affb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51192024-12-06T20:50:01.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d9623f04-cb07-4851-8071-10725875affb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51202024-12-06T20:50:01.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d9623f04-cb07-4851-8071-10725875affb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51212024-12-06T20:50:02.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 492 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = ea557b86-941d-477a-815c-3397e6d21ba9 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
51222024-12-06T20:50:02.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1a8de187-ee90-4c31-95ef-1dcda8ebabc1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51232024-12-06T20:50:02.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1a8de187-ee90-4c31-95ef-1dcda8ebabc1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51242024-12-06T20:50:02.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1a8de187-ee90-4c31-95ef-1dcda8ebabc1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51252024-12-06T20:50:03.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 262c71f0-6d34-4298-a725-877f47120181 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51262024-12-06T20:50:03.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 262c71f0-6d34-4298-a725-877f47120181 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51272024-12-06T20:50:03.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 262c71f0-6d34-4298-a725-877f47120181 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51282024-12-06T20:50:04.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fbe3e4a9-3787-4114-803a-9a3c2f7817c2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51292024-12-06T20:50:04.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fbe3e4a9-3787-4114-803a-9a3c2f7817c2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51302024-12-06T20:50:04.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fbe3e4a9-3787-4114-803a-9a3c2f7817c2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51312024-12-06T20:50:05.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11d658c1-c42e-4b08-9a45-733b37cd0eaa roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51322024-12-06T20:50:05.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11d658c1-c42e-4b08-9a45-733b37cd0eaa resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51332024-12-06T20:50:05.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11d658c1-c42e-4b08-9a45-733b37cd0eaa response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51342024-12-06T20:50:06.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 006899a1-f9b3-4be2-ac67-b417202105c2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51352024-12-06T20:50:06.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 006899a1-f9b3-4be2-ac67-b417202105c2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51362024-12-06T20:50:06.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 006899a1-f9b3-4be2-ac67-b417202105c2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51372024-12-06T20:50:07.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9845686a-526a-4894-8e95-03b67d081cd9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51382024-12-06T20:50:07.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9845686a-526a-4894-8e95-03b67d081cd9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51392024-12-06T20:50:07.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9845686a-526a-4894-8e95-03b67d081cd9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51402024-12-06T20:50:08.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e159e7d1-41c7-499e-9cf7-23ed8e1c51b7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51412024-12-06T20:50:08.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e159e7d1-41c7-499e-9cf7-23ed8e1c51b7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51422024-12-06T20:50:08.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e159e7d1-41c7-499e-9cf7-23ed8e1c51b7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51432024-12-06T20:50:08.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
51442024-12-06T20:50:08.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
51452024-12-06T20:50:08.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51462024-12-06T20:50:08.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51472024-12-06T20:50:08.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51482024-12-06T20:50:08.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51492024-12-06T20:50:08.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51502024-12-06T20:50:08.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51512024-12-06T20:50:08.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51522024-12-06T20:50:08.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51532024-12-06T20:50:08.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51542024-12-06T20:50:08.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51552024-12-06T20:50:08.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51562024-12-06T20:50:08.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
51572024-12-06T20:50:08.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51582024-12-06T20:50:08.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51592024-12-06T20:50:08.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
51602024-12-06T20:50:08.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.495691ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
51612024-12-06T20:50:08.890ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51622024-12-06T20:50:08.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51632024-12-06T20:50:08.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.79122ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51642024-12-06T20:50:09.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 17841082-6f62-43d1-8814-48641bfedf2a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51652024-12-06T20:50:09.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 17841082-6f62-43d1-8814-48641bfedf2a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51662024-12-06T20:50:09.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 17841082-6f62-43d1-8814-48641bfedf2a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51672024-12-06T20:50:10.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1e9ca2ee-ec02-47ee-885a-19870fa8bc78 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51682024-12-06T20:50:10.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1e9ca2ee-ec02-47ee-885a-19870fa8bc78 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51692024-12-06T20:50:10.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1e9ca2ee-ec02-47ee-885a-19870fa8bc78 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51702024-12-06T20:50:11.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = da64c41e-e580-42db-9dfe-f1acbbfd14e4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51712024-12-06T20:50:11.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = da64c41e-e580-42db-9dfe-f1acbbfd14e4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51722024-12-06T20:50:11.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = da64c41e-e580-42db-9dfe-f1acbbfd14e4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51732024-12-06T20:50:12.415ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 533 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 5ba3ad25-45d6-45ca-8f9f-ae733c9ec163 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
51742024-12-06T20:50:12.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 53d0f8fc-e264-441f-a98f-c367063cb0ab roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51752024-12-06T20:50:12.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 53d0f8fc-e264-441f-a98f-c367063cb0ab resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51762024-12-06T20:50:12.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 53d0f8fc-e264-441f-a98f-c367063cb0ab response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51772024-12-06T20:50:13.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = faffb750-f7d8-4b97-8da9-64caa6cb0ecc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51782024-12-06T20:50:13.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = faffb750-f7d8-4b97-8da9-64caa6cb0ecc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51792024-12-06T20:50:13.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = faffb750-f7d8-4b97-8da9-64caa6cb0ecc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51802024-12-06T20:50:14.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e1fd0e68-5f8c-4ebb-848c-2448b182025a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51812024-12-06T20:50:14.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e1fd0e68-5f8c-4ebb-848c-2448b182025a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51822024-12-06T20:50:14.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e1fd0e68-5f8c-4ebb-848c-2448b182025a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51832024-12-06T20:50:15.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ae91a37b-d37e-4133-b91c-95de15ddea69 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51842024-12-06T20:50:15.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ae91a37b-d37e-4133-b91c-95de15ddea69 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51852024-12-06T20:50:15.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ae91a37b-d37e-4133-b91c-95de15ddea69 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51862024-12-06T20:50:16.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ff57b7c0-f879-4604-9179-1d28c4f63c67 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51872024-12-06T20:50:16.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ff57b7c0-f879-4604-9179-1d28c4f63c67 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51882024-12-06T20:50:16.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ff57b7c0-f879-4604-9179-1d28c4f63c67 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51892024-12-06T20:50:17.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = beac1f56-0f33-409b-a46a-b36edfd84966 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51902024-12-06T20:50:17.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = beac1f56-0f33-409b-a46a-b36edfd84966 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51912024-12-06T20:50:17.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = beac1f56-0f33-409b-a46a-b36edfd84966 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
51922024-12-06T20:50:18.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
51932024-12-06T20:50:18.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51942024-12-06T20:50:18.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
51952024-12-06T20:50:18.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51962024-12-06T20:50:18.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51972024-12-06T20:50:18.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51982024-12-06T20:50:18.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51992024-12-06T20:50:18.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52002024-12-06T20:50:18.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52012024-12-06T20:50:18.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52022024-12-06T20:50:18.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52032024-12-06T20:50:18.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52042024-12-06T20:50:18.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52052024-12-06T20:50:18.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
52062024-12-06T20:50:18.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52072024-12-06T20:50:18.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52082024-12-06T20:50:18.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
52092024-12-06T20:50:18.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.882534ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
52102024-12-06T20:50:18.892ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52112024-12-06T20:50:18.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52122024-12-06T20:50:18.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.699277ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52132024-12-06T20:50:19.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11415213-3d1e-48fa-911e-7460a69d8749 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52142024-12-06T20:50:19.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11415213-3d1e-48fa-911e-7460a69d8749 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52152024-12-06T20:50:19.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11415213-3d1e-48fa-911e-7460a69d8749 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52162024-12-06T20:50:20.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0608889c-6b00-4647-918c-3554abe88720 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52172024-12-06T20:50:20.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0608889c-6b00-4647-918c-3554abe88720 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52182024-12-06T20:50:20.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0608889c-6b00-4647-918c-3554abe88720 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52192024-12-06T20:50:21.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9eca59d6-1c7e-4965-9c77-9575725011e7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52202024-12-06T20:50:21.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9eca59d6-1c7e-4965-9c77-9575725011e7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52212024-12-06T20:50:21.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9eca59d6-1c7e-4965-9c77-9575725011e7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52222024-12-06T20:50:22.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 55192c3a-d9bc-4fa4-96b1-2ebe8ab2d50f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52232024-12-06T20:50:22.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 55192c3a-d9bc-4fa4-96b1-2ebe8ab2d50f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52242024-12-06T20:50:22.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 55192c3a-d9bc-4fa4-96b1-2ebe8ab2d50f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52252024-12-06T20:50:22.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 530 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 8ac5b799-d506-463f-b013-d65755d991db response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
52262024-12-06T20:50:23.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 26eda65e-dab5-4f79-8c24-2f6cc669b9c3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52272024-12-06T20:50:23.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 26eda65e-dab5-4f79-8c24-2f6cc669b9c3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52282024-12-06T20:50:23.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 26eda65e-dab5-4f79-8c24-2f6cc669b9c3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52292024-12-06T20:50:24.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7a01bda5-624c-4390-aca3-2e5cc75cac8e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52302024-12-06T20:50:24.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7a01bda5-624c-4390-aca3-2e5cc75cac8e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52312024-12-06T20:50:24.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7a01bda5-624c-4390-aca3-2e5cc75cac8e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52322024-12-06T20:50:25.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5a042d9e-2f71-41bd-9509-300678e9cf76 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52332024-12-06T20:50:25.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5a042d9e-2f71-41bd-9509-300678e9cf76 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52342024-12-06T20:50:25.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5a042d9e-2f71-41bd-9509-300678e9cf76 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52352024-12-06T20:50:26.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c092a17d-afc8-49a1-9a4f-a90d6dfb0243 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52362024-12-06T20:50:26.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c092a17d-afc8-49a1-9a4f-a90d6dfb0243 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52372024-12-06T20:50:26.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c092a17d-afc8-49a1-9a4f-a90d6dfb0243 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52382024-12-06T20:50:27.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b0f1efe1-4695-4075-8017-6c96cc8bed79 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52392024-12-06T20:50:27.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b0f1efe1-4695-4075-8017-6c96cc8bed79 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52402024-12-06T20:50:27.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b0f1efe1-4695-4075-8017-6c96cc8bed79 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52412024-12-06T20:50:28.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4144fcb8-b59d-41aa-b33a-0a99f02ce7a7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52422024-12-06T20:50:28.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4144fcb8-b59d-41aa-b33a-0a99f02ce7a7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52432024-12-06T20:50:28.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4144fcb8-b59d-41aa-b33a-0a99f02ce7a7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
52442024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
52452024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52462024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
52472024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
52482024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
52492024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
52502024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52512024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52522024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52532024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
52542024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52552024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52562024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
52572024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
52582024-12-06T20:50:28.854ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:40:28.854173716 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52592024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52602024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
52612024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
52622024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
52632024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
52642024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52652024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52662024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52672024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
52682024-12-06T20:50:28.854ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
52692024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52702024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
52712024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52722024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
52732024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52742024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
52752024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
52762024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
52772024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52782024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
52792024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52802024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
52812024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
52822024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
52832024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
52842024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
52852024-12-06T20:50:28.854ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52862024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52872024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
52882024-12-06T20:50:28.854ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
52892024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
52902024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.081\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
52912024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52922024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
52932024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
52942024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52952024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52962024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52972024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
52982024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
52992024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
53002024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53012024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
53022024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53032024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
53042024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
53052024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53062024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
53072024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53082024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53092024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53102024-12-06T20:50:28.854ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6559, tv_nsec: 193350292 } })
53112024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53122024-12-06T20:50:28.854ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6559, tv_nsec: 193372972 } })
53132024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53142024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53152024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53162024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53172024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53182024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53192024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53202024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53212024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53222024-12-06T20:50:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53232024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53242024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53252024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53262024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53272024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
53282024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53292024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53302024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53312024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53322024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53332024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53342024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53352024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53362024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
53372024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.17464ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
53382024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
53392024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53402024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.225832ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
53412024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53422024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53432024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53442024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53452024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53462024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53472024-12-06T20:50:28.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53482024-12-06T20:50:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53492024-12-06T20:50:28.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53502024-12-06T20:50:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53512024-12-06T20:50:28.857ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:40:28.854173716 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53522024-12-06T20:50:28.857ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.912825ms iteration = 7 status = {"expiration":"2024-12-06T20:40:28.854173716Z","pruned":[]}
53532024-12-06T20:50:28.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53542024-12-06T20:50:28.857ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.144671ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53552024-12-06T20:50:28.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53562024-12-06T20:50:28.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53572024-12-06T20:50:28.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53582024-12-06T20:50:28.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53592024-12-06T20:50:28.861ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6559, tv_nsec: 200367093 } })
53602024-12-06T20:50:28.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53612024-12-06T20:50:28.862ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
53622024-12-06T20:50:28.863ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6559, tv_nsec: 202006165 } })
53632024-12-06T20:50:28.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
53642024-12-06T20:50:28.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53652024-12-06T20:50:28.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53662024-12-06T20:50:28.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53672024-12-06T20:50:28.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53682024-12-06T20:50:28.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53692024-12-06T20:50:28.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53702024-12-06T20:50:28.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53712024-12-06T20:50:28.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53722024-12-06T20:50:28.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53732024-12-06T20:50:28.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53742024-12-06T20:50:28.874ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53752024-12-06T20:50:28.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53762024-12-06T20:50:28.877ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.345272ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
53772024-12-06T20:50:28.878ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53782024-12-06T20:50:28.879ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53792024-12-06T20:50:28.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53802024-12-06T20:50:28.882ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53812024-12-06T20:50:28.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53822024-12-06T20:50:28.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53832024-12-06T20:50:28.884ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53842024-12-06T20:50:28.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53852024-12-06T20:50:28.885ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53862024-12-06T20:50:28.888ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53872024-12-06T20:50:28.888ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53882024-12-06T20:50:28.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53892024-12-06T20:50:28.894ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53902024-12-06T20:50:28.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53912024-12-06T20:50:28.898ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53922024-12-06T20:50:28.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53932024-12-06T20:50:28.898ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53942024-12-06T20:50:28.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53952024-12-06T20:50:28.901ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53962024-12-06T20:50:28.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53972024-12-06T20:50:28.902ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53982024-12-06T20:50:28.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53992024-12-06T20:50:28.904ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54002024-12-06T20:50:28.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54012024-12-06T20:50:28.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54022024-12-06T20:50:28.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54032024-12-06T20:50:28.907ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6559, tv_nsec: 245585728 } })
54042024-12-06T20:50:28.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54052024-12-06T20:50:28.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54062024-12-06T20:50:28.907ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
54072024-12-06T20:50:28.908ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54082024-12-06T20:50:28.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.115643ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54092024-12-06T20:50:28.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54102024-12-06T20:50:28.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54112024-12-06T20:50:28.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54122024-12-06T20:50:28.914ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54132024-12-06T20:50:28.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54142024-12-06T20:50:28.926ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54152024-12-06T20:50:28.926ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.250312ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54162024-12-06T20:50:28.928ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54172024-12-06T20:50:28.929ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54182024-12-06T20:50:28.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54192024-12-06T20:50:28.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54202024-12-06T20:50:28.932ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54212024-12-06T20:50:28.933ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54222024-12-06T20:50:28.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54232024-12-06T20:50:28.936ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54242024-12-06T20:50:28.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54252024-12-06T20:50:28.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54262024-12-06T20:50:28.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54272024-12-06T20:50:28.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54282024-12-06T20:50:28.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54292024-12-06T20:50:28.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54302024-12-06T20:50:28.942ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54312024-12-06T20:50:28.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54322024-12-06T20:50:28.946ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54332024-12-06T20:50:28.946ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54342024-12-06T20:50:28.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54352024-12-06T20:50:28.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54362024-12-06T20:50:28.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 92.590547ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
54372024-12-06T20:50:28.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 92.632108ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
54382024-12-06T20:50:28.947ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54392024-12-06T20:50:28.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54402024-12-06T20:50:28.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54412024-12-06T20:50:28.950ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54422024-12-06T20:50:28.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54432024-12-06T20:50:28.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54442024-12-06T20:50:28.952ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54452024-12-06T20:50:28.952ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54462024-12-06T20:50:28.952ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 97.867683ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
54472024-12-06T20:50:28.954ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54482024-12-06T20:50:28.954ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54492024-12-06T20:50:28.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54502024-12-06T20:50:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54512024-12-06T20:50:28.955ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54522024-12-06T20:50:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54532024-12-06T20:50:28.956ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54542024-12-06T20:50:28.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.486608ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54552024-12-06T20:50:28.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
54562024-12-06T20:50:28.960ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
54572024-12-06T20:50:28.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
54582024-12-06T20:50:28.962ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 108.441956ms iteration = 4 status = {"nsuccess":5}
54592024-12-06T20:50:28.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54602024-12-06T20:50:28.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54612024-12-06T20:50:28.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54622024-12-06T20:50:28.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54632024-12-06T20:50:28.976ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54642024-12-06T20:50:28.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54652024-12-06T20:50:28.977ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54662024-12-06T20:50:28.977ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54672024-12-06T20:50:28.977ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54682024-12-06T20:50:28.977ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54692024-12-06T20:50:28.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54702024-12-06T20:50:28.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54712024-12-06T20:50:28.982ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54722024-12-06T20:50:28.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54732024-12-06T20:50:28.984ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54742024-12-06T20:50:28.986ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54752024-12-06T20:50:28.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
54762024-12-06T20:50:28.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54772024-12-06T20:50:28.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54782024-12-06T20:50:28.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54792024-12-06T20:50:28.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54802024-12-06T20:50:28.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 138.197103ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54812024-12-06T20:50:28.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54822024-12-06T20:50:28.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54832024-12-06T20:50:28.995ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 141.543579ms iteration = 13 status = 0
54842024-12-06T20:50:28.997ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
54852024-12-06T20:50:29.006ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54862024-12-06T20:50:29.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54872024-12-06T20:50:29.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54882024-12-06T20:50:29.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54892024-12-06T20:50:29.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54902024-12-06T20:50:29.011ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
54912024-12-06T20:50:29.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54922024-12-06T20:50:29.013ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54932024-12-06T20:50:29.013ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
54942024-12-06T20:50:29.013ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
54952024-12-06T20:50:29.013ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 159.536713ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
54962024-12-06T20:50:29.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54972024-12-06T20:50:29.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54982024-12-06T20:50:29.015ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54992024-12-06T20:50:29.015ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55002024-12-06T20:50:29.015ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87d9e929-7b0d-4181-9499-d7a0164ae8f3", "content-length": "26", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} })
55012024-12-06T20:50:29.015ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55022024-12-06T20:50:29.018ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55032024-12-06T20:50:29.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
55042024-12-06T20:50:29.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55052024-12-06T20:50:29.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55062024-12-06T20:50:29.024ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55072024-12-06T20:50:29.024ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55082024-12-06T20:50:29.024ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 169.926241ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55092024-12-06T20:50:29.037ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
55102024-12-06T20:50:29.037ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 183.320116ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
55112024-12-06T20:50:29.040ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55122024-12-06T20:50:29.040ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55132024-12-06T20:50:29.040ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55142024-12-06T20:50:29.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55152024-12-06T20:50:29.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55162024-12-06T20:50:29.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55172024-12-06T20:50:29.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55182024-12-06T20:50:29.049ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55192024-12-06T20:50:29.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55202024-12-06T20:50:29.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 196.471385ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55212024-12-06T20:50:29.051ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55222024-12-06T20:50:29.051ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
55232024-12-06T20:50:29.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55242024-12-06T20:50:29.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55252024-12-06T20:50:29.052ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55262024-12-06T20:50:29.052ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55272024-12-06T20:50:29.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55282024-12-06T20:50:29.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55292024-12-06T20:50:29.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55302024-12-06T20:50:29.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55312024-12-06T20:50:29.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55322024-12-06T20:50:29.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55332024-12-06T20:50:29.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55342024-12-06T20:50:29.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55352024-12-06T20:50:29.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55362024-12-06T20:50:29.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55372024-12-06T20:50:29.062ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
55382024-12-06T20:50:29.063ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55392024-12-06T20:50:29.063ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
55402024-12-06T20:50:29.063ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 208.895735ms iteration = 7 status = {"generation":2}
55412024-12-06T20:50:29.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55422024-12-06T20:50:29.064ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
55432024-12-06T20:50:29.064ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55442024-12-06T20:50:29.064ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
55452024-12-06T20:50:29.064ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 210.786014ms iteration = 7 status = {"generation":1}
55462024-12-06T20:50:29.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55472024-12-06T20:50:29.074ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55482024-12-06T20:50:29.074ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55492024-12-06T20:50:29.074ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "80b31405-ab52-4c74-a178-b86a2b012182", "content-length": "26", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} })
55502024-12-06T20:50:29.074ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55512024-12-06T20:50:29.076ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55522024-12-06T20:50:29.080ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) }
55532024-12-06T20:50:29.080ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 225.879653ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55542024-12-06T20:50:29.101ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 247.111961ms iteration = 15 status = {"physical_disks_added":0}
55552024-12-06T20:50:29.121ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
55562024-12-06T20:50:29.121ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 267.605039ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
55572024-12-06T20:50:29.133ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
55582024-12-06T20:50:29.133ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55592024-12-06T20:50:29.133ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c03eed0-2fad-4162-9818-a4abc45547d2", "content-length": "26", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} })
55602024-12-06T20:50:29.133ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55612024-12-06T20:50:29.136ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
55622024-12-06T20:50:29.165ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55632024-12-06T20:50:29.165ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55642024-12-06T20:50:29.166ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cc625de8-4e72-4399-a441-c2d8212b193a", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55652024-12-06T20:50:29.166ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55662024-12-06T20:50:29.168ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "81060c40-7760-4009-8ee3-bf4c0991536e", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55672024-12-06T20:50:29.168ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55682024-12-06T20:50:29.170ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55692024-12-06T20:50:29.170ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 316.816817ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55702024-12-06T20:50:29.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55712024-12-06T20:50:29.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55722024-12-06T20:50:29.176ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 322.289009ms iteration = 13 status = {}
55732024-12-06T20:50:29.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55742024-12-06T20:50:29.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55752024-12-06T20:50:29.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55762024-12-06T20:50:29.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55772024-12-06T20:50:29.180ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55782024-12-06T20:50:29.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55792024-12-06T20:50:29.182ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55802024-12-06T20:50:29.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55812024-12-06T20:50:29.212ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55822024-12-06T20:50:29.212ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55832024-12-06T20:50:29.212ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "43bee7d2-ccfb-41dc-b123-7855cc4e9a1c", "content-length": "372", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} })
55842024-12-06T20:50:29.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55852024-12-06T20:50:29.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55862024-12-06T20:50:29.227ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
55872024-12-06T20:50:29.227ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55882024-12-06T20:50:29.227ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e987478e-6d22-4a06-b9e0-ff7aedd3cf6d", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} })
55892024-12-06T20:50:29.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55902024-12-06T20:50:29.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55912024-12-06T20:50:29.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55922024-12-06T20:50:29.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55932024-12-06T20:50:29.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3080c7e6-9405-4058-bf53-14a66aa25015 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
55942024-12-06T20:50:29.229ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55952024-12-06T20:50:29.229ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "11aff4dd-9e72-4645-a94a-7df269e86cae", "content-length": "1", "date": "Fri, 06 Dec 2024 20:50:28 GMT"} })
55962024-12-06T20:50:29.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3080c7e6-9405-4058-bf53-14a66aa25015 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
55972024-12-06T20:50:29.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3080c7e6-9405-4058-bf53-14a66aa25015 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
55982024-12-06T20:50:29.231ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55992024-12-06T20:50:29.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56002024-12-06T20:50:29.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56012024-12-06T20:50:29.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56022024-12-06T20:50:29.272ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
56032024-12-06T20:50:29.272ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5b01236e-c5b1-4455-94d5-0125639e26d4", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56042024-12-06T20:50:29.273ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56052024-12-06T20:50:29.274ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3e96987e-ba7c-4e0a-9495-7caaab1706d8", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56062024-12-06T20:50:29.274ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56072024-12-06T20:50:29.276ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "efe0058f-6cc9-4e79-884e-a94ddd3e8140", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56082024-12-06T20:50:29.277ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56092024-12-06T20:50:29.278ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
56102024-12-06T20:50:29.278ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 424.793371ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56112024-12-06T20:50:29.284ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56122024-12-06T20:50:29.285ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0937bf8-a13c-451b-8b2a-6d039fbe6ac2", "content-length": "691", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} })
56132024-12-06T20:50:29.285ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
56142024-12-06T20:50:29.285ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
56152024-12-06T20:50:29.285ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
56162024-12-06T20:50:29.286ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 432.461699ms iteration = 13 status = null
56172024-12-06T20:50:29.287ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 432.671365ms iteration = 13 status = {}
56182024-12-06T20:50:29.287ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56192024-12-06T20:50:29.287ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56202024-12-06T20:50:29.287ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f938757a-8fbc-4516-a0cb-78c43725ef51", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} })
56212024-12-06T20:50:29.289ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 435.518648ms iteration = 13 status = {}
56222024-12-06T20:50:29.333ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56232024-12-06T20:50:29.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56242024-12-06T20:50:29.335ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
56252024-12-06T20:50:29.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56262024-12-06T20:50:29.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56272024-12-06T20:50:29.342ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56282024-12-06T20:50:29.342ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f77e821-33cd-490c-886a-4e86b2964c26", "content-length": "134", "date": "Fri, 06 Dec 2024 20:50:28 GMT"} })
56292024-12-06T20:50:29.342ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56302024-12-06T20:50:29.342ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
56312024-12-06T20:50:29.342ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56322024-12-06T20:50:29.342ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56332024-12-06T20:50:29.342ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56342024-12-06T20:50:29.342ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56352024-12-06T20:50:29.342ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56362024-12-06T20:50:29.342ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56372024-12-06T20:50:29.342ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56382024-12-06T20:50:29.343ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56392024-12-06T20:50:29.343ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
56402024-12-06T20:50:29.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56412024-12-06T20:50:29.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56422024-12-06T20:50:29.344ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56432024-12-06T20:50:29.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2edae65d-9847-4057-9eba-6b545d1b676c", "content-length": "2", "date": "Fri, 06 Dec 2024 20:50:28 GMT"} })
56442024-12-06T20:50:29.345ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56452024-12-06T20:50:29.345ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f84cee0-cfd4-4997-aa33-cc63c08f07ef", "content-length": "52", "date": "Fri, 06 Dec 2024 20:50:28 GMT"} })
56462024-12-06T20:50:29.345ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
56472024-12-06T20:50:29.345ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56482024-12-06T20:50:29.435ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
56492024-12-06T20:50:29.435ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
56502024-12-06T20:50:29.466ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
56512024-12-06T20:50:29.467ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:58032
56522024-12-06T20:50:29.467ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bf6f273e-b02c-4020-b42b-95517d966404", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} })
56532024-12-06T20:50:29.467ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
56542024-12-06T20:50:29.467ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56552024-12-06T20:50:29.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58032 req_id = f947c4ec-08cc-407e-9ceb-21de91f72fed roles = RoleSet { roles: {} } uri = /metrics/producers
56562024-12-06T20:50:29.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58032 req_id = f947c4ec-08cc-407e-9ceb-21de91f72fed resource = Database result = Ok(()) uri = /metrics/producers
56572024-12-06T20:50:29.467ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e52bbd9-adbd-4370-8082-2cd18c62dbff", "content-length": "682", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} })
56582024-12-06T20:50:29.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56592024-12-06T20:50:29.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56602024-12-06T20:50:29.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56612024-12-06T20:50:29.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56622024-12-06T20:50:29.475ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56632024-12-06T20:50:29.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56642024-12-06T20:50:29.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56652024-12-06T20:50:29.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56662024-12-06T20:50:29.485ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 631.456389ms iteration = 13 status = {}
56672024-12-06T20:50:29.502ZINFOnexus: assigned collector to new producer collector_id = bef145b4-2934-45c3-870a-63d45572bde4 file = nexus/src/app/oximeter.rs:76 producer_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
56682024-12-06T20:50:29.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35077 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58032 req_id = f947c4ec-08cc-407e-9ceb-21de91f72fed response_code = 201 uri = /metrics/producers
56692024-12-06T20:50:29.502ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f947c4ec-08cc-407e-9ceb-21de91f72fed", "content-length": "41", "date": "Fri, 06 Dec 2024 20:50:29 GMT"} })
56702024-12-06T20:50:29.504ZDEBGnexus (producer-registration-task): registered with nexus successfully
56712024-12-06T20:50:29.504ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
56722024-12-06T20:50:30.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d99a253b-e1cb-4909-8b7c-d49ee6c8daf9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56732024-12-06T20:50:30.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d99a253b-e1cb-4909-8b7c-d49ee6c8daf9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56742024-12-06T20:50:30.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d99a253b-e1cb-4909-8b7c-d49ee6c8daf9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56752024-12-06T20:50:31.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76bf862e-201a-4b61-bec5-73e0d07d822f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56762024-12-06T20:50:31.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76bf862e-201a-4b61-bec5-73e0d07d822f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56772024-12-06T20:50:31.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76bf862e-201a-4b61-bec5-73e0d07d822f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56782024-12-06T20:50:32.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 767ebdd0-86f5-4858-a573-b0377ed7c773 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56792024-12-06T20:50:32.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 767ebdd0-86f5-4858-a573-b0377ed7c773 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56802024-12-06T20:50:32.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 767ebdd0-86f5-4858-a573-b0377ed7c773 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56812024-12-06T20:50:32.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 914f10c2-759c-4c04-80c9-67ac164be450 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
56822024-12-06T20:50:33.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6bb64702-5ab2-4615-972c-27fec3fa4cfd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56832024-12-06T20:50:33.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6bb64702-5ab2-4615-972c-27fec3fa4cfd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56842024-12-06T20:50:33.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6bb64702-5ab2-4615-972c-27fec3fa4cfd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56852024-12-06T20:50:34.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7c37ae65-cda1-41d2-89e2-9c1172f2e1f0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56862024-12-06T20:50:34.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7c37ae65-cda1-41d2-89e2-9c1172f2e1f0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56872024-12-06T20:50:34.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7c37ae65-cda1-41d2-89e2-9c1172f2e1f0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56882024-12-06T20:50:35.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e0a5948-5cf0-4a14-9a3b-bdd6d0e1739e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56892024-12-06T20:50:35.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e0a5948-5cf0-4a14-9a3b-bdd6d0e1739e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56902024-12-06T20:50:35.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e0a5948-5cf0-4a14-9a3b-bdd6d0e1739e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56912024-12-06T20:50:36.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d69ac87-105a-42c6-a839-c50e7cc60833 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56922024-12-06T20:50:36.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d69ac87-105a-42c6-a839-c50e7cc60833 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56932024-12-06T20:50:36.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d69ac87-105a-42c6-a839-c50e7cc60833 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56942024-12-06T20:50:37.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3d3ec234-dc8a-4adc-be77-d10d131a630f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56952024-12-06T20:50:37.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3d3ec234-dc8a-4adc-be77-d10d131a630f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56962024-12-06T20:50:37.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3d3ec234-dc8a-4adc-be77-d10d131a630f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56972024-12-06T20:50:38.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d4f7736-cb7b-42f0-aff8-a50f6d74367d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56982024-12-06T20:50:38.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d4f7736-cb7b-42f0-aff8-a50f6d74367d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
56992024-12-06T20:50:38.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d4f7736-cb7b-42f0-aff8-a50f6d74367d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57002024-12-06T20:50:38.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
57012024-12-06T20:50:38.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
57022024-12-06T20:50:38.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57032024-12-06T20:50:38.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57042024-12-06T20:50:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57052024-12-06T20:50:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57062024-12-06T20:50:38.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57072024-12-06T20:50:38.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57082024-12-06T20:50:38.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57092024-12-06T20:50:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57102024-12-06T20:50:38.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57112024-12-06T20:50:38.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57122024-12-06T20:50:38.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57132024-12-06T20:50:38.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57142024-12-06T20:50:38.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57152024-12-06T20:50:38.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
57162024-12-06T20:50:38.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57172024-12-06T20:50:38.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57182024-12-06T20:50:38.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
57192024-12-06T20:50:38.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.272658ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
57202024-12-06T20:50:38.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.752413ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57212024-12-06T20:50:39.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3c2c7c29-8b56-4c4b-a1ba-10aadd0e0bfc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57222024-12-06T20:50:39.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3c2c7c29-8b56-4c4b-a1ba-10aadd0e0bfc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57232024-12-06T20:50:39.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3c2c7c29-8b56-4c4b-a1ba-10aadd0e0bfc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57242024-12-06T20:50:40.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0baa3dd9-9c90-45e8-b75c-ac30980b8625 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57252024-12-06T20:50:40.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0baa3dd9-9c90-45e8-b75c-ac30980b8625 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57262024-12-06T20:50:40.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0baa3dd9-9c90-45e8-b75c-ac30980b8625 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57272024-12-06T20:50:41.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a4d49f1a-8974-4f2f-9290-79ed783c26ba roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57282024-12-06T20:50:41.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a4d49f1a-8974-4f2f-9290-79ed783c26ba resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57292024-12-06T20:50:41.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a4d49f1a-8974-4f2f-9290-79ed783c26ba response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57302024-12-06T20:50:42.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 438 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 2e9466f6-3faa-472d-81ed-97611baac704 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
57312024-12-06T20:50:42.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f0dff1e2-7851-4837-b79e-3e9cb37c9cad roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57322024-12-06T20:50:42.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f0dff1e2-7851-4837-b79e-3e9cb37c9cad resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57332024-12-06T20:50:42.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f0dff1e2-7851-4837-b79e-3e9cb37c9cad response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57342024-12-06T20:50:43.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4884b2f7-23e7-453a-a46d-5abca36e6182 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57352024-12-06T20:50:43.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4884b2f7-23e7-453a-a46d-5abca36e6182 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57362024-12-06T20:50:43.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4884b2f7-23e7-453a-a46d-5abca36e6182 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57372024-12-06T20:50:44.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 813716f7-7d07-49ff-a921-81b6b6bb49ce roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57382024-12-06T20:50:44.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 813716f7-7d07-49ff-a921-81b6b6bb49ce resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57392024-12-06T20:50:44.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 813716f7-7d07-49ff-a921-81b6b6bb49ce response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57402024-12-06T20:50:45.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11500ef6-eb00-432b-9a15-a82442c7e811 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57412024-12-06T20:50:45.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11500ef6-eb00-432b-9a15-a82442c7e811 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57422024-12-06T20:50:45.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11500ef6-eb00-432b-9a15-a82442c7e811 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57432024-12-06T20:50:46.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02449fa0-236f-4d78-8bb5-bcc716af1100 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57442024-12-06T20:50:46.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02449fa0-236f-4d78-8bb5-bcc716af1100 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57452024-12-06T20:50:46.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02449fa0-236f-4d78-8bb5-bcc716af1100 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57462024-12-06T20:50:47.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e3ff4760-ac4b-4d71-90b1-66060600c6e3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57472024-12-06T20:50:47.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e3ff4760-ac4b-4d71-90b1-66060600c6e3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57482024-12-06T20:50:47.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e3ff4760-ac4b-4d71-90b1-66060600c6e3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57492024-12-06T20:50:48.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 98ed1471-e59d-4505-bdbd-5b26585f0e5d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57502024-12-06T20:50:48.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 98ed1471-e59d-4505-bdbd-5b26585f0e5d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57512024-12-06T20:50:48.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 98ed1471-e59d-4505-bdbd-5b26585f0e5d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57522024-12-06T20:50:48.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
57532024-12-06T20:50:48.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
57542024-12-06T20:50:48.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57552024-12-06T20:50:48.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57562024-12-06T20:50:48.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57572024-12-06T20:50:48.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57582024-12-06T20:50:48.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57592024-12-06T20:50:48.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57602024-12-06T20:50:48.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57612024-12-06T20:50:48.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.525861ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57622024-12-06T20:50:48.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57632024-12-06T20:50:48.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57642024-12-06T20:50:48.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57652024-12-06T20:50:48.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57662024-12-06T20:50:48.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57672024-12-06T20:50:48.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57682024-12-06T20:50:48.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
57692024-12-06T20:50:48.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57702024-12-06T20:50:48.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57712024-12-06T20:50:48.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
57722024-12-06T20:50:48.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.352203ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
57732024-12-06T20:50:49.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b89a8b5e-213f-426b-85e0-30f3781ca645 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57742024-12-06T20:50:49.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b89a8b5e-213f-426b-85e0-30f3781ca645 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57752024-12-06T20:50:49.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b89a8b5e-213f-426b-85e0-30f3781ca645 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57762024-12-06T20:50:50.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2050869d-1320-439e-ba9d-e5246ffa8a41 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57772024-12-06T20:50:50.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2050869d-1320-439e-ba9d-e5246ffa8a41 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57782024-12-06T20:50:50.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2050869d-1320-439e-ba9d-e5246ffa8a41 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57792024-12-06T20:50:51.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8e921c36-fdd4-4377-9dbb-a9b0f852cdcc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57802024-12-06T20:50:51.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8e921c36-fdd4-4377-9dbb-a9b0f852cdcc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57812024-12-06T20:50:51.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8e921c36-fdd4-4377-9dbb-a9b0f852cdcc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57822024-12-06T20:50:52.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 542 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 15328bb3-809a-432a-a612-a56f5c0e4bd4 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
57832024-12-06T20:50:52.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0a07b830-3bc0-43a5-aeb8-53d436fc1860 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57842024-12-06T20:50:52.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0a07b830-3bc0-43a5-aeb8-53d436fc1860 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57852024-12-06T20:50:52.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0a07b830-3bc0-43a5-aeb8-53d436fc1860 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57862024-12-06T20:50:53.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7c97a713-ed13-4d18-b9bc-417f0314c806 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57872024-12-06T20:50:53.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7c97a713-ed13-4d18-b9bc-417f0314c806 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57882024-12-06T20:50:53.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7c97a713-ed13-4d18-b9bc-417f0314c806 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57892024-12-06T20:50:54.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c8347739-3de0-4c6e-bca8-3fd3c74efe75 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57902024-12-06T20:50:54.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c8347739-3de0-4c6e-bca8-3fd3c74efe75 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57912024-12-06T20:50:54.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c8347739-3de0-4c6e-bca8-3fd3c74efe75 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57922024-12-06T20:50:55.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d08734e-b582-45e4-96b5-4b08458625d9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57932024-12-06T20:50:55.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d08734e-b582-45e4-96b5-4b08458625d9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57942024-12-06T20:50:55.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5d08734e-b582-45e4-96b5-4b08458625d9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57952024-12-06T20:50:56.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f3b12352-5993-4220-844d-53b08327bf8f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57962024-12-06T20:50:56.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f3b12352-5993-4220-844d-53b08327bf8f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57972024-12-06T20:50:56.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f3b12352-5993-4220-844d-53b08327bf8f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57982024-12-06T20:50:57.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c849d8d-1bc5-47da-b3b6-926301471afb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
57992024-12-06T20:50:57.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c849d8d-1bc5-47da-b3b6-926301471afb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
58002024-12-06T20:50:57.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c849d8d-1bc5-47da-b3b6-926301471afb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
58012024-12-06T20:50:58.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e4a085dd-fdd9-43c0-a852-11a43dccf9d2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
58022024-12-06T20:50:58.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e4a085dd-fdd9-43c0-a852-11a43dccf9d2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
58032024-12-06T20:50:58.853ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
58042024-12-06T20:50:58.853ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58052024-12-06T20:50:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58062024-12-06T20:50:58.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e4a085dd-fdd9-43c0-a852-11a43dccf9d2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
58072024-12-06T20:50:58.854ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
58082024-12-06T20:50:58.854ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
58092024-12-06T20:50:58.854ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58102024-12-06T20:50:58.854ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58112024-12-06T20:50:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
58122024-12-06T20:50:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58132024-12-06T20:50:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
58142024-12-06T20:50:58.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58152024-12-06T20:50:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58162024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
58172024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
58182024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58192024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58202024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58212024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
58222024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
58232024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58242024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58252024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
58262024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58272024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
58282024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
58292024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58302024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58312024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
58322024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
58332024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58342024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58352024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
58362024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58372024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
58382024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58392024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
58402024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58412024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58422024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58432024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58442024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58452024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58462024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58472024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58482024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58492024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58502024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58512024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58522024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58532024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58542024-12-06T20:50:58.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58552024-12-06T20:50:58.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6589, tv_nsec: 194818230 } })
58562024-12-06T20:50:58.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58572024-12-06T20:50:58.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58582024-12-06T20:50:58.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58592024-12-06T20:50:58.858ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.955576ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58602024-12-06T20:50:58.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6589, tv_nsec: 197375826 } })
58612024-12-06T20:50:58.858ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58622024-12-06T20:50:58.858ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58632024-12-06T20:50:58.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58642024-12-06T20:50:58.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58652024-12-06T20:50:58.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58662024-12-06T20:50:58.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58672024-12-06T20:50:58.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58682024-12-06T20:50:58.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58692024-12-06T20:50:58.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58702024-12-06T20:50:58.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58712024-12-06T20:50:58.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58722024-12-06T20:50:58.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58732024-12-06T20:50:58.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58742024-12-06T20:50:58.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58752024-12-06T20:50:58.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58762024-12-06T20:50:58.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58772024-12-06T20:50:58.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58782024-12-06T20:50:58.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58792024-12-06T20:50:58.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58802024-12-06T20:50:58.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58812024-12-06T20:50:58.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58822024-12-06T20:50:58.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58832024-12-06T20:50:58.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.770953ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
58842024-12-06T20:50:58.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58852024-12-06T20:50:58.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58862024-12-06T20:50:58.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58872024-12-06T20:50:58.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58882024-12-06T20:50:58.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.655092ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58892024-12-06T20:50:58.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58902024-12-06T20:50:58.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58912024-12-06T20:50:58.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58922024-12-06T20:50:58.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58932024-12-06T20:50:58.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58942024-12-06T20:50:58.873ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58952024-12-06T20:50:58.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58962024-12-06T20:50:58.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58972024-12-06T20:50:58.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58982024-12-06T20:50:58.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58992024-12-06T20:50:58.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59002024-12-06T20:50:58.879ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6589, tv_nsec: 218663985 } })
59012024-12-06T20:50:58.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59022024-12-06T20:50:58.880ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
59032024-12-06T20:50:58.881ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59042024-12-06T20:50:58.881ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59052024-12-06T20:50:58.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59062024-12-06T20:50:58.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59072024-12-06T20:50:58.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59082024-12-06T20:50:58.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
59092024-12-06T20:50:58.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59102024-12-06T20:50:58.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59112024-12-06T20:50:58.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59122024-12-06T20:50:58.887ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59132024-12-06T20:50:58.887ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 32.190499ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59142024-12-06T20:50:58.900ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 45.111563ms iteration = 16 status = {"physical_disks_added":0}
59152024-12-06T20:50:58.900ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
59162024-12-06T20:50:58.900ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.707889ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
59172024-12-06T20:50:58.904ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59182024-12-06T20:50:58.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59192024-12-06T20:50:58.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.903649ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
59202024-12-06T20:50:58.914ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59212024-12-06T20:50:58.914ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59222024-12-06T20:50:58.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59232024-12-06T20:50:58.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59242024-12-06T20:50:58.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59252024-12-06T20:50:58.918ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59262024-12-06T20:50:58.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59272024-12-06T20:50:58.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59282024-12-06T20:50:58.924ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59292024-12-06T20:50:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59302024-12-06T20:50:58.946ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59312024-12-06T20:50:58.947ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59322024-12-06T20:50:58.947ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e25e526-5450-470e-a6cc-ed5544a99f8f", "content-length": "26", "date": "Fri, 06 Dec 2024 20:50:58 GMT"} })
59332024-12-06T20:50:58.947ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59342024-12-06T20:50:58.948ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59352024-12-06T20:50:58.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59362024-12-06T20:50:58.960ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59372024-12-06T20:50:58.960ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d077031-a966-4316-89d5-f066bb7b77b1", "content-length": "26", "date": "Fri, 06 Dec 2024 20:50:58 GMT"} })
59382024-12-06T20:50:58.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59392024-12-06T20:50:58.963ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59402024-12-06T20:50:58.975ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
59412024-12-06T20:50:58.975ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59422024-12-06T20:50:58.975ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5ddd035-9b93-49bf-a6af-ceda7dc2c7f0", "content-length": "26", "date": "Fri, 06 Dec 2024 20:50:58 GMT"} })
59432024-12-06T20:50:58.975ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59442024-12-06T20:50:58.977ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
59452024-12-06T20:50:58.981ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59462024-12-06T20:50:58.981ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59472024-12-06T20:50:58.982ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dc6ba93-532b-4adc-82fb-dce3579b821e", "content-length": "372", "date": "Fri, 06 Dec 2024 20:50:58 GMT"} })
59482024-12-06T20:50:58.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59492024-12-06T20:50:58.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59502024-12-06T20:50:58.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59512024-12-06T20:50:58.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59522024-12-06T20:50:58.984ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59532024-12-06T20:50:58.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59542024-12-06T20:50:58.985ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59552024-12-06T20:50:58.985ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59562024-12-06T20:50:58.985ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.169856ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59572024-12-06T20:50:58.985ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59582024-12-06T20:50:58.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59592024-12-06T20:50:59.002ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
59602024-12-06T20:50:59.002ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59612024-12-06T20:50:59.003ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "247784ab-5bbf-40ee-9240-b9b6b070bfd0", "date": "Fri, 06 Dec 2024 20:50:58 GMT"} })
59622024-12-06T20:50:59.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59632024-12-06T20:50:59.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59642024-12-06T20:50:59.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59652024-12-06T20:50:59.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59662024-12-06T20:50:59.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59672024-12-06T20:50:59.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59682024-12-06T20:50:59.012ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59692024-12-06T20:50:59.012ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59702024-12-06T20:50:59.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5aac705a-caec-4661-a124-f9eb87f6525f", "date": "Fri, 06 Dec 2024 20:50:58 GMT"} })
59712024-12-06T20:50:59.014ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 159.43217ms iteration = 14 status = {}
59722024-12-06T20:50:59.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 161.390881ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59732024-12-06T20:50:59.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59742024-12-06T20:50:59.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
59752024-12-06T20:50:59.019ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59762024-12-06T20:50:59.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59772024-12-06T20:50:59.020ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 165.855806ms iteration = 14 status = 0
59782024-12-06T20:50:59.021ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 166.051961ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59792024-12-06T20:50:59.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 169.228373ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59802024-12-06T20:50:59.026ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59812024-12-06T20:50:59.027ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "04d9cc3d-c8e4-41c3-8199-fa6bbe7688bd", "content-length": "1", "date": "Fri, 06 Dec 2024 20:50:58 GMT"} })
59822024-12-06T20:50:59.029ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59832024-12-06T20:50:59.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59842024-12-06T20:50:59.032ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 179.117448ms iteration = 14 status = null
59852024-12-06T20:50:59.046ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 191.933138ms iteration = 14 status = {}
59862024-12-06T20:50:59.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59872024-12-06T20:50:59.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59882024-12-06T20:50:59.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59892024-12-06T20:50:59.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59902024-12-06T20:50:59.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59912024-12-06T20:50:59.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59922024-12-06T20:50:59.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59932024-12-06T20:50:59.093ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59942024-12-06T20:50:59.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59952024-12-06T20:50:59.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59962024-12-06T20:50:59.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59972024-12-06T20:50:59.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59982024-12-06T20:50:59.116ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
59992024-12-06T20:50:59.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60002024-12-06T20:50:59.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60012024-12-06T20:50:59.127ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60022024-12-06T20:50:59.127ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9fc66c3-e53f-4ba4-b12e-1aff090ccfb9", "content-length": "134", "date": "Fri, 06 Dec 2024 20:50:58 GMT"} })
60032024-12-06T20:50:59.127ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60042024-12-06T20:50:59.127ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
60052024-12-06T20:50:59.127ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60062024-12-06T20:50:59.127ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60072024-12-06T20:50:59.127ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60082024-12-06T20:50:59.127ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60092024-12-06T20:50:59.127ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60102024-12-06T20:50:59.127ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60112024-12-06T20:50:59.127ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60122024-12-06T20:50:59.127ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60132024-12-06T20:50:59.128ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
60142024-12-06T20:50:59.128ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60152024-12-06T20:50:59.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60162024-12-06T20:50:59.130ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60172024-12-06T20:50:59.130ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bab39f87-6910-4373-9b30-4b1eb3b72136", "content-length": "2", "date": "Fri, 06 Dec 2024 20:50:58 GMT"} })
60182024-12-06T20:50:59.130ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60192024-12-06T20:50:59.130ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f75957f-a02d-43d1-8ec0-e27d8e1cb172", "content-length": "52", "date": "Fri, 06 Dec 2024 20:50:58 GMT"} })
60202024-12-06T20:50:59.130ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
60212024-12-06T20:50:59.130ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60222024-12-06T20:50:59.184ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60232024-12-06T20:50:59.229ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "79ee5a4c-67b5-40e0-8e45-d9821b36ca87", "date": "Fri, 06 Dec 2024 20:50:58 GMT"} })
60242024-12-06T20:50:59.229ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
60252024-12-06T20:50:59.229ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60262024-12-06T20:50:59.230ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "730a158e-f221-49e5-bd51-0b2e55cb2d7c", "content-length": "682", "date": "Fri, 06 Dec 2024 20:50:59 GMT"} })
60272024-12-06T20:50:59.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60282024-12-06T20:50:59.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60292024-12-06T20:50:59.230ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "613f6d0e-c200-425e-aa21-31d625323bd4", "content-length": "691", "date": "Fri, 06 Dec 2024 20:50:59 GMT"} })
60302024-12-06T20:50:59.230ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
60312024-12-06T20:50:59.230ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
60322024-12-06T20:50:59.230ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
60332024-12-06T20:50:59.232ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 377.550263ms iteration = 14 status = {}
60342024-12-06T20:50:59.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60352024-12-06T20:50:59.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60362024-12-06T20:50:59.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60372024-12-06T20:50:59.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60382024-12-06T20:50:59.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60392024-12-06T20:50:59.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60402024-12-06T20:50:59.247ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 392.323614ms iteration = 14 status = {}
60412024-12-06T20:50:59.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 60177452-03f2-4d80-8755-a4aa6ecd8f74 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60422024-12-06T20:50:59.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 60177452-03f2-4d80-8755-a4aa6ecd8f74 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60432024-12-06T20:50:59.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 60177452-03f2-4d80-8755-a4aa6ecd8f74 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60442024-12-06T20:51:00.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f2e2e355-32e3-4bb5-bd1e-fd52a59de44f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60452024-12-06T20:51:00.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f2e2e355-32e3-4bb5-bd1e-fd52a59de44f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60462024-12-06T20:51:00.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f2e2e355-32e3-4bb5-bd1e-fd52a59de44f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60472024-12-06T20:51:01.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 490b79d4-7153-4765-9c44-fb8d9855faa5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60482024-12-06T20:51:01.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 490b79d4-7153-4765-9c44-fb8d9855faa5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60492024-12-06T20:51:01.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 490b79d4-7153-4765-9c44-fb8d9855faa5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60502024-12-06T20:51:02.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 443 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 12550e97-6443-4b01-9df3-f4f0ac49bebf response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
60512024-12-06T20:51:02.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8f919aac-d836-4b51-8c93-e39be6261ba7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60522024-12-06T20:51:02.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8f919aac-d836-4b51-8c93-e39be6261ba7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60532024-12-06T20:51:02.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8f919aac-d836-4b51-8c93-e39be6261ba7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60542024-12-06T20:51:03.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9812fa30-47d2-4fc2-82ac-cacad0a440c5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60552024-12-06T20:51:03.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9812fa30-47d2-4fc2-82ac-cacad0a440c5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60562024-12-06T20:51:03.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9812fa30-47d2-4fc2-82ac-cacad0a440c5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60572024-12-06T20:51:04.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3811fff7-518d-4a3f-a27a-8da674b8181c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60582024-12-06T20:51:04.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3811fff7-518d-4a3f-a27a-8da674b8181c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60592024-12-06T20:51:04.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3811fff7-518d-4a3f-a27a-8da674b8181c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60602024-12-06T20:51:06.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75149665-0774-4207-bd9e-5e4de87ee637 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60612024-12-06T20:51:06.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75149665-0774-4207-bd9e-5e4de87ee637 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60622024-12-06T20:51:06.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75149665-0774-4207-bd9e-5e4de87ee637 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60632024-12-06T20:51:07.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e302eacd-1cc2-4775-a3fd-28c00f74d113 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60642024-12-06T20:51:07.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e302eacd-1cc2-4775-a3fd-28c00f74d113 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60652024-12-06T20:51:07.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e302eacd-1cc2-4775-a3fd-28c00f74d113 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60662024-12-06T20:51:08.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6f8cf797-60d0-4e49-83b3-99e4c8bf59ad roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60672024-12-06T20:51:08.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6f8cf797-60d0-4e49-83b3-99e4c8bf59ad resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60682024-12-06T20:51:08.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6f8cf797-60d0-4e49-83b3-99e4c8bf59ad response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60692024-12-06T20:51:08.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
60702024-12-06T20:51:08.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
60712024-12-06T20:51:08.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60722024-12-06T20:51:08.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60732024-12-06T20:51:08.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60742024-12-06T20:51:08.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60752024-12-06T20:51:08.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60762024-12-06T20:51:08.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60772024-12-06T20:51:08.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60782024-12-06T20:51:08.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60792024-12-06T20:51:08.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60802024-12-06T20:51:08.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60812024-12-06T20:51:08.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60822024-12-06T20:51:08.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
60832024-12-06T20:51:08.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60842024-12-06T20:51:08.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60852024-12-06T20:51:08.878ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
60862024-12-06T20:51:08.878ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.789723ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
60872024-12-06T20:51:08.884ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60882024-12-06T20:51:08.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60892024-12-06T20:51:08.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.240027ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60902024-12-06T20:51:09.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eff1182b-7a17-4c20-8893-60900004cdbc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60912024-12-06T20:51:09.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eff1182b-7a17-4c20-8893-60900004cdbc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60922024-12-06T20:51:09.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eff1182b-7a17-4c20-8893-60900004cdbc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60932024-12-06T20:51:10.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 14c11574-6a72-4d9e-83a5-0a8201732ca0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60942024-12-06T20:51:10.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 14c11574-6a72-4d9e-83a5-0a8201732ca0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60952024-12-06T20:51:10.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 14c11574-6a72-4d9e-83a5-0a8201732ca0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60962024-12-06T20:51:11.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb8ef2dc-3420-4056-9d55-f9edd9af95d3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60972024-12-06T20:51:11.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb8ef2dc-3420-4056-9d55-f9edd9af95d3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60982024-12-06T20:51:11.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb8ef2dc-3420-4056-9d55-f9edd9af95d3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
60992024-12-06T20:51:12.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d76cd572-8091-46c1-8d45-cf237b0cc178 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61002024-12-06T20:51:12.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d76cd572-8091-46c1-8d45-cf237b0cc178 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61012024-12-06T20:51:12.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d76cd572-8091-46c1-8d45-cf237b0cc178 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61022024-12-06T20:51:12.404ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:55570
61032024-12-06T20:51:12.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = 39109b8a-42fa-4acb-a25c-497d986d7292 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
61042024-12-06T20:51:12.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = 39109b8a-42fa-4acb-a25c-497d986d7292 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
61052024-12-06T20:51:12.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = 39109b8a-42fa-4acb-a25c-497d986d7292 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
61062024-12-06T20:51:12.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = aa42ab80-e772-4ebe-8956-1f60e5501f0f roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
61072024-12-06T20:51:12.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = aa42ab80-e772-4ebe-8956-1f60e5501f0f resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
61082024-12-06T20:51:12.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = aa42ab80-e772-4ebe-8956-1f60e5501f0f response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
61092024-12-06T20:51:12.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 513 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 4765f9a1-92e7-408d-8a60-da8710ad2563 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
61102024-12-06T20:51:13.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6293e9c8-5e27-4c73-ae24-ed938f4ee465 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61112024-12-06T20:51:13.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6293e9c8-5e27-4c73-ae24-ed938f4ee465 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61122024-12-06T20:51:13.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6293e9c8-5e27-4c73-ae24-ed938f4ee465 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61132024-12-06T20:51:14.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9b4cb2ca-beaf-4dff-86fb-383e9852df2d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61142024-12-06T20:51:14.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9b4cb2ca-beaf-4dff-86fb-383e9852df2d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61152024-12-06T20:51:14.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9b4cb2ca-beaf-4dff-86fb-383e9852df2d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61162024-12-06T20:51:15.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cf3f187b-4217-496d-ab8c-6724d63213a3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61172024-12-06T20:51:15.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cf3f187b-4217-496d-ab8c-6724d63213a3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61182024-12-06T20:51:15.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cf3f187b-4217-496d-ab8c-6724d63213a3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61192024-12-06T20:51:16.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 014ec89d-4697-4848-9d12-9735ed9e3dba roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61202024-12-06T20:51:16.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 014ec89d-4697-4848-9d12-9735ed9e3dba resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61212024-12-06T20:51:16.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 014ec89d-4697-4848-9d12-9735ed9e3dba response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61222024-12-06T20:51:17.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7870d290-b2a1-4625-a44a-697bf890e2aa roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61232024-12-06T20:51:17.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7870d290-b2a1-4625-a44a-697bf890e2aa resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61242024-12-06T20:51:17.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7870d290-b2a1-4625-a44a-697bf890e2aa response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61252024-12-06T20:51:18.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 40f7b40e-5281-4d64-b88f-7174ee307ff7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61262024-12-06T20:51:18.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 40f7b40e-5281-4d64-b88f-7174ee307ff7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61272024-12-06T20:51:18.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 40f7b40e-5281-4d64-b88f-7174ee307ff7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61282024-12-06T20:51:18.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
61292024-12-06T20:51:18.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61302024-12-06T20:51:18.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
61312024-12-06T20:51:18.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61322024-12-06T20:51:18.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61332024-12-06T20:51:18.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61342024-12-06T20:51:18.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61352024-12-06T20:51:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61362024-12-06T20:51:18.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61372024-12-06T20:51:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61382024-12-06T20:51:18.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61392024-12-06T20:51:18.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61402024-12-06T20:51:18.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61412024-12-06T20:51:18.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
61422024-12-06T20:51:18.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61432024-12-06T20:51:18.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61442024-12-06T20:51:18.881ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
61452024-12-06T20:51:18.881ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.458678ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
61462024-12-06T20:51:18.884ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61472024-12-06T20:51:18.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61482024-12-06T20:51:18.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.98866ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61492024-12-06T20:51:19.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c65b0401-105a-4ad1-970a-defbef1e5e6e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61502024-12-06T20:51:19.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c65b0401-105a-4ad1-970a-defbef1e5e6e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61512024-12-06T20:51:19.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c65b0401-105a-4ad1-970a-defbef1e5e6e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61522024-12-06T20:51:20.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4bbfbe68-1711-4a15-97e7-49ce950312f1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61532024-12-06T20:51:20.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4bbfbe68-1711-4a15-97e7-49ce950312f1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61542024-12-06T20:51:20.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4bbfbe68-1711-4a15-97e7-49ce950312f1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61552024-12-06T20:51:21.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8dcef18-f88b-4712-bdd7-170d0fb8de8f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61562024-12-06T20:51:21.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8dcef18-f88b-4712-bdd7-170d0fb8de8f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61572024-12-06T20:51:21.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8dcef18-f88b-4712-bdd7-170d0fb8de8f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61582024-12-06T20:51:22.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70ae0a54-12f2-4546-a7e3-4b2a13764551 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61592024-12-06T20:51:22.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70ae0a54-12f2-4546-a7e3-4b2a13764551 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61602024-12-06T20:51:22.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70ae0a54-12f2-4546-a7e3-4b2a13764551 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61612024-12-06T20:51:22.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 550 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 4e65286b-70c0-4f65-a6d0-ccd6621f74d5 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
61622024-12-06T20:51:23.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc5669ab-98a8-47f6-8ed4-e510534c1844 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61632024-12-06T20:51:23.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc5669ab-98a8-47f6-8ed4-e510534c1844 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61642024-12-06T20:51:23.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc5669ab-98a8-47f6-8ed4-e510534c1844 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61652024-12-06T20:51:24.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c720347d-de9a-4623-a8d3-01816a380d2f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61662024-12-06T20:51:24.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c720347d-de9a-4623-a8d3-01816a380d2f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61672024-12-06T20:51:24.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c720347d-de9a-4623-a8d3-01816a380d2f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61682024-12-06T20:51:25.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad5b2dd3-713e-4dff-9e17-e2ac38856df9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61692024-12-06T20:51:25.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad5b2dd3-713e-4dff-9e17-e2ac38856df9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61702024-12-06T20:51:25.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad5b2dd3-713e-4dff-9e17-e2ac38856df9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61712024-12-06T20:51:26.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7595cd6f-b6ee-44d4-82cf-1ed04ca402b3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61722024-12-06T20:51:26.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7595cd6f-b6ee-44d4-82cf-1ed04ca402b3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61732024-12-06T20:51:26.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7595cd6f-b6ee-44d4-82cf-1ed04ca402b3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61742024-12-06T20:51:27.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 82809e2e-5aa9-4d18-95dd-5c61272477cc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61752024-12-06T20:51:27.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 82809e2e-5aa9-4d18-95dd-5c61272477cc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61762024-12-06T20:51:27.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 82809e2e-5aa9-4d18-95dd-5c61272477cc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61772024-12-06T20:51:28.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a9882ae8-a995-4d1b-a24d-762b53a4e9fe roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61782024-12-06T20:51:28.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a9882ae8-a995-4d1b-a24d-762b53a4e9fe resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61792024-12-06T20:51:28.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a9882ae8-a995-4d1b-a24d-762b53a4e9fe response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
61802024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
61812024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61822024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
61832024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
61842024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
61852024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61862024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
61872024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61882024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61892024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
61902024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
61912024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
61922024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61932024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61942024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
61952024-12-06T20:51:28.853ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:41:28.853680762 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61962024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61972024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
61982024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
61992024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62002024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
62012024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62022024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
62032024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62042024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
62052024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
62062024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
62072024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
62082024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
62092024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62102024-12-06T20:51:28.853ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62112024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62122024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
62132024-12-06T20:51:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62142024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
62152024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
62162024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62172024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
62182024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62192024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
62202024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62212024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62222024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
62232024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62242024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
62252024-12-06T20:51:28.854ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
62262024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62272024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
62282024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62292024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62302024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
62312024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62322024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
62332024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
62342024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62352024-12-06T20:51:28.854ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
62362024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
62372024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62382024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
62392024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62402024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.04\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
62412024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62422024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
62432024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62442024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62452024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62462024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62472024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62482024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62492024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62502024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62512024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62522024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62532024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
62542024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62552024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62562024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62572024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62582024-12-06T20:51:28.854ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6619, tv_nsec: 193601267 } })
62592024-12-06T20:51:28.854ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6619, tv_nsec: 193620718 } })
62602024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62612024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62622024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62632024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62642024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62652024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62662024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62672024-12-06T20:51:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62682024-12-06T20:51:28.855ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
62692024-12-06T20:51:28.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.427977ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
62702024-12-06T20:51:28.855ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
62712024-12-06T20:51:28.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.503679ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
62722024-12-06T20:51:28.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62732024-12-06T20:51:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62742024-12-06T20:51:28.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62752024-12-06T20:51:28.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6619, tv_nsec: 195779374 } })
62762024-12-06T20:51:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62772024-12-06T20:51:28.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
62782024-12-06T20:51:28.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62792024-12-06T20:51:28.857ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.977683ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62802024-12-06T20:51:28.858ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62812024-12-06T20:51:28.858ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:41:28.853680762 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62822024-12-06T20:51:28.858ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.715552ms iteration = 8 status = {"expiration":"2024-12-06T20:41:28.853680762Z","pruned":[]}
62832024-12-06T20:51:28.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62842024-12-06T20:51:28.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62852024-12-06T20:51:28.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62862024-12-06T20:51:28.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62872024-12-06T20:51:28.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62882024-12-06T20:51:28.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62892024-12-06T20:51:28.862ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.785206ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
62902024-12-06T20:51:28.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62912024-12-06T20:51:28.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62922024-12-06T20:51:28.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62932024-12-06T20:51:28.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62942024-12-06T20:51:28.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62952024-12-06T20:51:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62962024-12-06T20:51:28.865ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62972024-12-06T20:51:28.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62982024-12-06T20:51:28.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62992024-12-06T20:51:28.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63002024-12-06T20:51:28.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63012024-12-06T20:51:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63022024-12-06T20:51:28.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63032024-12-06T20:51:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63042024-12-06T20:51:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63052024-12-06T20:51:28.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63062024-12-06T20:51:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63072024-12-06T20:51:28.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63082024-12-06T20:51:28.875ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6619, tv_nsec: 214237799 } })
63092024-12-06T20:51:28.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63102024-12-06T20:51:28.875ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
63112024-12-06T20:51:28.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63122024-12-06T20:51:28.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63132024-12-06T20:51:28.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63142024-12-06T20:51:28.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63152024-12-06T20:51:28.880ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63162024-12-06T20:51:28.880ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63172024-12-06T20:51:28.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63182024-12-06T20:51:28.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63192024-12-06T20:51:28.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63202024-12-06T20:51:28.884ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63212024-12-06T20:51:28.884ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63222024-12-06T20:51:28.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63232024-12-06T20:51:28.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63242024-12-06T20:51:28.885ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6619, tv_nsec: 224719600 } })
63252024-12-06T20:51:28.886ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
63262024-12-06T20:51:28.892ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63272024-12-06T20:51:28.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63282024-12-06T20:51:28.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63292024-12-06T20:51:28.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
63302024-12-06T20:51:28.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63312024-12-06T20:51:28.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63322024-12-06T20:51:28.922ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63332024-12-06T20:51:28.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63342024-12-06T20:51:28.924ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
63352024-12-06T20:51:28.924ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
63362024-12-06T20:51:28.924ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.550169ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
63372024-12-06T20:51:28.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.045174ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63382024-12-06T20:51:28.926ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63392024-12-06T20:51:28.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
63402024-12-06T20:51:28.930ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63412024-12-06T20:51:28.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63422024-12-06T20:51:28.931ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.690492ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
63432024-12-06T20:51:28.933ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63442024-12-06T20:51:28.934ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63452024-12-06T20:51:28.934ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63462024-12-06T20:51:28.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63472024-12-06T20:51:28.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 81.430809ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
63482024-12-06T20:51:28.936ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63492024-12-06T20:51:28.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63502024-12-06T20:51:28.942ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63512024-12-06T20:51:28.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63522024-12-06T20:51:28.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63532024-12-06T20:51:28.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63542024-12-06T20:51:28.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.843925ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63552024-12-06T20:51:28.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 95.654526ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
63562024-12-06T20:51:28.952ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63572024-12-06T20:51:28.954ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
63582024-12-06T20:51:28.954ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.056645ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
63592024-12-06T20:51:28.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63602024-12-06T20:51:28.954ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63612024-12-06T20:51:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63622024-12-06T20:51:28.956ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63632024-12-06T20:51:28.956ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 102.159874ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63642024-12-06T20:51:28.956ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
63652024-12-06T20:51:28.956ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
63662024-12-06T20:51:28.956ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
63672024-12-06T20:51:28.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63682024-12-06T20:51:28.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63692024-12-06T20:51:28.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63702024-12-06T20:51:28.958ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63712024-12-06T20:51:28.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63722024-12-06T20:51:28.959ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63732024-12-06T20:51:28.959ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63742024-12-06T20:51:28.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63752024-12-06T20:51:28.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63762024-12-06T20:51:28.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63772024-12-06T20:51:28.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63782024-12-06T20:51:28.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63792024-12-06T20:51:28.963ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63802024-12-06T20:51:28.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63812024-12-06T20:51:28.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63822024-12-06T20:51:28.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63832024-12-06T20:51:28.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63842024-12-06T20:51:28.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63852024-12-06T20:51:28.968ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63862024-12-06T20:51:28.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63872024-12-06T20:51:28.969ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63882024-12-06T20:51:28.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
63892024-12-06T20:51:28.972ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63902024-12-06T20:51:28.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63912024-12-06T20:51:28.977ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 123.852643ms iteration = 15 status = 0
63922024-12-06T20:51:28.981ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63932024-12-06T20:51:28.982ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.627776ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63942024-12-06T20:51:28.983ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63952024-12-06T20:51:28.983ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
63962024-12-06T20:51:28.983ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 129.498159ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63972024-12-06T20:51:28.985ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
63982024-12-06T20:51:28.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
63992024-12-06T20:51:28.988ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64002024-12-06T20:51:28.988ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64012024-12-06T20:51:28.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64022024-12-06T20:51:28.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64032024-12-06T20:51:28.989ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
64042024-12-06T20:51:28.989ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
64052024-12-06T20:51:28.989ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
64062024-12-06T20:51:28.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64072024-12-06T20:51:28.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64082024-12-06T20:51:28.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64092024-12-06T20:51:28.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64102024-12-06T20:51:28.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64112024-12-06T20:51:28.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64122024-12-06T20:51:28.996ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
64132024-12-06T20:51:28.996ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
64142024-12-06T20:51:28.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64152024-12-06T20:51:28.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64162024-12-06T20:51:28.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64172024-12-06T20:51:29.000ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
64182024-12-06T20:51:29.000ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
64192024-12-06T20:51:29.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64202024-12-06T20:51:29.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64212024-12-06T20:51:29.000ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64222024-12-06T20:51:29.000ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64232024-12-06T20:51:29.001ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d87fd2d4-22d6-4ad7-86c4-5a9e8b7e5a52", "content-length": "26", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} })
64242024-12-06T20:51:29.001ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64252024-12-06T20:51:29.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64262024-12-06T20:51:29.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64272024-12-06T20:51:29.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64282024-12-06T20:51:29.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64292024-12-06T20:51:29.003ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64302024-12-06T20:51:29.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64312024-12-06T20:51:29.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64322024-12-06T20:51:29.004ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
64332024-12-06T20:51:29.004ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64342024-12-06T20:51:29.004ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
64352024-12-06T20:51:29.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 150.947942ms iteration = 8 status = {"generation":1}
64362024-12-06T20:51:29.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64372024-12-06T20:51:29.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64382024-12-06T20:51:29.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64392024-12-06T20:51:29.006ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
64402024-12-06T20:51:29.006ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
64412024-12-06T20:51:29.006ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
64422024-12-06T20:51:29.006ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 153.048326ms iteration = 8 status = {"generation":2}
64432024-12-06T20:51:29.008ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64442024-12-06T20:51:29.010ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64452024-12-06T20:51:29.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64462024-12-06T20:51:29.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64472024-12-06T20:51:29.014ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
64482024-12-06T20:51:29.018ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 164.48032ms iteration = 17 status = {"physical_disks_added":0}
64492024-12-06T20:51:29.018ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64502024-12-06T20:51:29.018ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64512024-12-06T20:51:29.018ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 164.947183ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64522024-12-06T20:51:29.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64532024-12-06T20:51:29.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64542024-12-06T20:51:29.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64552024-12-06T20:51:29.036ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64562024-12-06T20:51:29.036ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64572024-12-06T20:51:29.037ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "908a43ba-4dcd-4802-aefc-1add25136c51", "content-length": "26", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} })
64582024-12-06T20:51:29.037ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64592024-12-06T20:51:29.038ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64602024-12-06T20:51:29.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64612024-12-06T20:51:29.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64622024-12-06T20:51:29.038ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64632024-12-06T20:51:29.038ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
64642024-12-06T20:51:29.038ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64652024-12-06T20:51:29.039ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1aa227c4-b357-4fa1-8789-7d9fd06fd499", "content-length": "26", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} })
64662024-12-06T20:51:29.039ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64672024-12-06T20:51:29.040ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
64682024-12-06T20:51:29.053ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
64692024-12-06T20:51:29.053ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 199.592146ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
64702024-12-06T20:51:29.065ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) }
64712024-12-06T20:51:29.065ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 211.759129ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64722024-12-06T20:51:29.138ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
64732024-12-06T20:51:29.138ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "96af3a00-bf42-46de-abf3-dcfce2092a09", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64742024-12-06T20:51:29.138ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64752024-12-06T20:51:29.141ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "19a5bc34-db92-41d3-86f9-38e7fab64329", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64762024-12-06T20:51:29.141ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64772024-12-06T20:51:29.142ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64782024-12-06T20:51:29.142ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 289.429061ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
64792024-12-06T20:51:29.163ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64802024-12-06T20:51:29.164ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "511428a8-54cd-4233-afef-6ea92067db2d", "content-length": "1", "date": "Fri, 06 Dec 2024 20:51:28 GMT"} })
64812024-12-06T20:51:29.166ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64822024-12-06T20:51:29.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64832024-12-06T20:51:29.183ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64842024-12-06T20:51:29.184ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64852024-12-06T20:51:29.184ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64862024-12-06T20:51:29.184ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc799b76-c777-4223-b0c6-3b533e5c8034", "content-length": "372", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} })
64872024-12-06T20:51:29.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64882024-12-06T20:51:29.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64892024-12-06T20:51:29.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64902024-12-06T20:51:29.186ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 333.309993ms iteration = 15 status = null
64912024-12-06T20:51:29.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64922024-12-06T20:51:29.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64932024-12-06T20:51:29.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64942024-12-06T20:51:29.193ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 339.592795ms iteration = 15 status = {}
64952024-12-06T20:51:29.228ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
64962024-12-06T20:51:29.228ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64972024-12-06T20:51:29.228ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a6888c08-bc57-4843-915d-838f2112ea3d", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} })
64982024-12-06T20:51:29.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64992024-12-06T20:51:29.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65002024-12-06T20:51:29.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65012024-12-06T20:51:29.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65022024-12-06T20:51:29.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65032024-12-06T20:51:29.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65042024-12-06T20:51:29.236ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
65052024-12-06T20:51:29.236ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65062024-12-06T20:51:29.237ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4d97eeee-1d96-480e-8e0e-25cb8ef087fe", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} })
65072024-12-06T20:51:29.238ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 385.079578ms iteration = 15 status = {}
65082024-12-06T20:51:29.251ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
65092024-12-06T20:51:29.251ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3cb79ae2-cf42-493a-a52f-e946370f4921", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65102024-12-06T20:51:29.251ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65112024-12-06T20:51:29.253ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d62b9bc5-5f76-4dce-b441-f09e7c8f7fb9", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65122024-12-06T20:51:29.253ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65132024-12-06T20:51:29.255ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "480cbfaf-5bbc-4b0f-bed4-0ff20e2c4ba0", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65142024-12-06T20:51:29.255ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65152024-12-06T20:51:29.257ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
65162024-12-06T20:51:29.257ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 403.687977ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
65172024-12-06T20:51:29.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65182024-12-06T20:51:29.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65192024-12-06T20:51:29.304ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
65202024-12-06T20:51:29.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65212024-12-06T20:51:29.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65222024-12-06T20:51:29.307ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65232024-12-06T20:51:29.308ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d97e163-9de3-42ed-b7a3-70715faa9500", "content-length": "691", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} })
65242024-12-06T20:51:29.308ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
65252024-12-06T20:51:29.308ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
65262024-12-06T20:51:29.308ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
65272024-12-06T20:51:29.308ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 455.032221ms iteration = 15 status = {}
65282024-12-06T20:51:29.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65292024-12-06T20:51:29.317ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "08dfe9b2-1603-4ed3-a7d2-19ce57cb9917", "content-length": "134", "date": "Fri, 06 Dec 2024 20:51:28 GMT"} })
65302024-12-06T20:51:29.317ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
65312024-12-06T20:51:29.317ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
65322024-12-06T20:51:29.317ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65332024-12-06T20:51:29.317ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65342024-12-06T20:51:29.317ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65352024-12-06T20:51:29.317ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65362024-12-06T20:51:29.317ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65372024-12-06T20:51:29.317ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65382024-12-06T20:51:29.317ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65392024-12-06T20:51:29.317ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65402024-12-06T20:51:29.317ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
65412024-12-06T20:51:29.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65422024-12-06T20:51:29.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65432024-12-06T20:51:29.320ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65442024-12-06T20:51:29.320ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "767443f4-166f-466c-9228-886e2e176c16", "content-length": "2", "date": "Fri, 06 Dec 2024 20:51:28 GMT"} })
65452024-12-06T20:51:29.320ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65462024-12-06T20:51:29.320ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b10988d-2a7b-4d39-98bc-1b02d1be594c", "content-length": "52", "date": "Fri, 06 Dec 2024 20:51:28 GMT"} })
65472024-12-06T20:51:29.320ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
65482024-12-06T20:51:29.320ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65492024-12-06T20:51:29.418ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f8f62c2f-47b6-4067-b2bd-88f0568be863", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} })
65502024-12-06T20:51:29.418ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
65512024-12-06T20:51:29.418ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65522024-12-06T20:51:29.419ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2be67bc-95cb-40e2-8816-7438ea46efe6", "content-length": "682", "date": "Fri, 06 Dec 2024 20:51:29 GMT"} })
65532024-12-06T20:51:29.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65542024-12-06T20:51:29.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65552024-12-06T20:51:29.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65562024-12-06T20:51:29.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65572024-12-06T20:51:29.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65582024-12-06T20:51:29.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65592024-12-06T20:51:29.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65602024-12-06T20:51:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65612024-12-06T20:51:29.436ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 583.152373ms iteration = 15 status = {}
65622024-12-06T20:51:29.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02209538-0b61-4683-b05e-1b564ece1498 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65632024-12-06T20:51:29.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02209538-0b61-4683-b05e-1b564ece1498 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65642024-12-06T20:51:29.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02209538-0b61-4683-b05e-1b564ece1498 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65652024-12-06T20:51:30.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 09f52ab5-b3bc-43a0-8d1c-455855ec44a7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65662024-12-06T20:51:30.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 09f52ab5-b3bc-43a0-8d1c-455855ec44a7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65672024-12-06T20:51:30.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 09f52ab5-b3bc-43a0-8d1c-455855ec44a7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65682024-12-06T20:51:31.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 47c251f9-aff8-467c-88c4-5f1f54aeda32 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65692024-12-06T20:51:31.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 47c251f9-aff8-467c-88c4-5f1f54aeda32 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65702024-12-06T20:51:31.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 47c251f9-aff8-467c-88c4-5f1f54aeda32 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65712024-12-06T20:51:32.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 443 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 492df604-40a6-403c-be4e-41ee4efb72b7 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
65722024-12-06T20:51:32.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e766afe4-3b01-4377-a602-74778be60a6f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65732024-12-06T20:51:32.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e766afe4-3b01-4377-a602-74778be60a6f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65742024-12-06T20:51:32.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e766afe4-3b01-4377-a602-74778be60a6f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65752024-12-06T20:51:33.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e9c031b4-f2f6-4bb6-b09e-a3623afc0c71 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65762024-12-06T20:51:33.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e9c031b4-f2f6-4bb6-b09e-a3623afc0c71 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65772024-12-06T20:51:33.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e9c031b4-f2f6-4bb6-b09e-a3623afc0c71 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65782024-12-06T20:51:34.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b740156b-d38e-4af9-a36f-5b3a53572e23 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65792024-12-06T20:51:34.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b740156b-d38e-4af9-a36f-5b3a53572e23 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65802024-12-06T20:51:34.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b740156b-d38e-4af9-a36f-5b3a53572e23 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65812024-12-06T20:51:35.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c1fbf51-8815-469e-8b01-b1bb1ff843d4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65822024-12-06T20:51:35.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c1fbf51-8815-469e-8b01-b1bb1ff843d4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65832024-12-06T20:51:35.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c1fbf51-8815-469e-8b01-b1bb1ff843d4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65842024-12-06T20:51:36.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 30d31c5d-cea0-49a1-8d50-c70eedcfb99c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65852024-12-06T20:51:36.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 30d31c5d-cea0-49a1-8d50-c70eedcfb99c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65862024-12-06T20:51:36.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 30d31c5d-cea0-49a1-8d50-c70eedcfb99c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65872024-12-06T20:51:37.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 03677e5c-4ab1-4ba9-98be-0c4c450ec58c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65882024-12-06T20:51:37.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 03677e5c-4ab1-4ba9-98be-0c4c450ec58c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65892024-12-06T20:51:37.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 03677e5c-4ab1-4ba9-98be-0c4c450ec58c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65902024-12-06T20:51:38.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8a2cb0e7-634e-4124-95d6-6784f57e778f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65912024-12-06T20:51:38.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8a2cb0e7-634e-4124-95d6-6784f57e778f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65922024-12-06T20:51:38.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8a2cb0e7-634e-4124-95d6-6784f57e778f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
65932024-12-06T20:51:38.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
65942024-12-06T20:51:38.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
65952024-12-06T20:51:38.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65962024-12-06T20:51:38.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65972024-12-06T20:51:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65982024-12-06T20:51:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65992024-12-06T20:51:38.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66002024-12-06T20:51:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66012024-12-06T20:51:38.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66022024-12-06T20:51:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66032024-12-06T20:51:38.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66042024-12-06T20:51:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66052024-12-06T20:51:38.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66062024-12-06T20:51:38.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
66072024-12-06T20:51:38.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66082024-12-06T20:51:38.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66092024-12-06T20:51:38.877ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
66102024-12-06T20:51:38.877ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.520166ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
66112024-12-06T20:51:38.885ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66122024-12-06T20:51:38.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66132024-12-06T20:51:38.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.983781ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66142024-12-06T20:51:39.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f9b2af31-f374-4c65-b30b-6a52ad3b22cc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66152024-12-06T20:51:39.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f9b2af31-f374-4c65-b30b-6a52ad3b22cc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66162024-12-06T20:51:39.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f9b2af31-f374-4c65-b30b-6a52ad3b22cc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66172024-12-06T20:51:40.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4de3df8b-7016-40cc-af6e-1444428ecab3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66182024-12-06T20:51:40.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4de3df8b-7016-40cc-af6e-1444428ecab3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66192024-12-06T20:51:40.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4de3df8b-7016-40cc-af6e-1444428ecab3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66202024-12-06T20:51:41.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05f3bc7e-492b-4286-bbe5-aa0bc3b25d73 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66212024-12-06T20:51:41.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05f3bc7e-492b-4286-bbe5-aa0bc3b25d73 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66222024-12-06T20:51:41.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05f3bc7e-492b-4286-bbe5-aa0bc3b25d73 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66232024-12-06T20:51:42.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = 4adbb1aa-8e5b-424c-9ae9-feeeea42588f roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
66242024-12-06T20:51:42.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = 4adbb1aa-8e5b-424c-9ae9-feeeea42588f resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
66252024-12-06T20:51:42.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = 4adbb1aa-8e5b-424c-9ae9-feeeea42588f response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
66262024-12-06T20:51:42.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = 4489f304-f7a9-4120-a226-39f8ed4336d4 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
66272024-12-06T20:51:42.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = 4489f304-f7a9-4120-a226-39f8ed4336d4 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
66282024-12-06T20:51:42.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55570 req_id = 4489f304-f7a9-4120-a226-39f8ed4336d4 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
66292024-12-06T20:51:42.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 466 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = b3b3eb43-e4ad-4be8-b33c-934849a30b8c response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
66302024-12-06T20:51:42.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3cbf5e94-6bb7-4db3-a4cb-fb822c06fd84 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66312024-12-06T20:51:42.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3cbf5e94-6bb7-4db3-a4cb-fb822c06fd84 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66322024-12-06T20:51:42.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3cbf5e94-6bb7-4db3-a4cb-fb822c06fd84 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66332024-12-06T20:51:43.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 59edba83-d136-468d-ad15-8b6e804f7d02 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66342024-12-06T20:51:43.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 59edba83-d136-468d-ad15-8b6e804f7d02 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66352024-12-06T20:51:43.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 59edba83-d136-468d-ad15-8b6e804f7d02 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66362024-12-06T20:51:44.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d85d96e8-1fff-4c6e-8551-6ca5dd5109e3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66372024-12-06T20:51:44.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d85d96e8-1fff-4c6e-8551-6ca5dd5109e3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66382024-12-06T20:51:44.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d85d96e8-1fff-4c6e-8551-6ca5dd5109e3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66392024-12-06T20:51:45.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7e1d235e-4439-4860-9843-437e6402a461 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66402024-12-06T20:51:45.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7e1d235e-4439-4860-9843-437e6402a461 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66412024-12-06T20:51:45.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7e1d235e-4439-4860-9843-437e6402a461 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66422024-12-06T20:51:46.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 69d6db06-c3b1-49e3-b305-83d6738dfa6f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66432024-12-06T20:51:46.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 69d6db06-c3b1-49e3-b305-83d6738dfa6f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66442024-12-06T20:51:46.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 69d6db06-c3b1-49e3-b305-83d6738dfa6f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66452024-12-06T20:51:47.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fb83d15b-89c7-46fb-9797-0b6eadfdcd36 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66462024-12-06T20:51:47.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fb83d15b-89c7-46fb-9797-0b6eadfdcd36 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66472024-12-06T20:51:47.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2666 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fb83d15b-89c7-46fb-9797-0b6eadfdcd36 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66482024-12-06T20:51:48.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
66492024-12-06T20:51:48.854ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
66502024-12-06T20:51:48.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66512024-12-06T20:51:48.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66522024-12-06T20:51:48.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66532024-12-06T20:51:48.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66542024-12-06T20:51:48.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66552024-12-06T20:51:48.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66562024-12-06T20:51:48.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66572024-12-06T20:51:48.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66582024-12-06T20:51:48.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66592024-12-06T20:51:48.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66602024-12-06T20:51:48.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66612024-12-06T20:51:48.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
66622024-12-06T20:51:48.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66632024-12-06T20:51:48.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66642024-12-06T20:51:48.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
66652024-12-06T20:51:48.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.132041ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
66662024-12-06T20:51:48.884ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66672024-12-06T20:51:48.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66682024-12-06T20:51:48.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.267582ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66692024-12-06T20:51:48.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 94604f3f-1f36-4bc8-8304-a915ae08b80c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66702024-12-06T20:51:48.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 94604f3f-1f36-4bc8-8304-a915ae08b80c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66712024-12-06T20:51:48.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 94604f3f-1f36-4bc8-8304-a915ae08b80c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66722024-12-06T20:51:49.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4c26545b-4eb0-41cc-96f7-b552fb90613a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66732024-12-06T20:51:49.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4c26545b-4eb0-41cc-96f7-b552fb90613a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66742024-12-06T20:51:49.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4c26545b-4eb0-41cc-96f7-b552fb90613a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66752024-12-06T20:51:50.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 684d78f9-ac97-4eb9-9158-a658ca0a4a2d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66762024-12-06T20:51:50.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 684d78f9-ac97-4eb9-9158-a658ca0a4a2d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66772024-12-06T20:51:50.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 684d78f9-ac97-4eb9-9158-a658ca0a4a2d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66782024-12-06T20:51:52.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cdc2ea63-1d76-4d3e-961c-9ad95d09862e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66792024-12-06T20:51:52.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cdc2ea63-1d76-4d3e-961c-9ad95d09862e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66802024-12-06T20:51:52.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cdc2ea63-1d76-4d3e-961c-9ad95d09862e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66812024-12-06T20:51:52.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 488 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = eb814948-d2eb-4e34-8fbe-4c7c01d819b6 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
66822024-12-06T20:51:53.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13dec145-5c53-4028-ae9a-83b2ec3a97bc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66832024-12-06T20:51:53.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13dec145-5c53-4028-ae9a-83b2ec3a97bc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66842024-12-06T20:51:53.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13dec145-5c53-4028-ae9a-83b2ec3a97bc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66852024-12-06T20:51:54.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1fd34e70-dd34-4dd9-ab2f-40de24fc135e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66862024-12-06T20:51:54.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1fd34e70-dd34-4dd9-ab2f-40de24fc135e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66872024-12-06T20:51:54.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1fd34e70-dd34-4dd9-ab2f-40de24fc135e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66882024-12-06T20:51:55.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2622bd3a-e035-42cf-ac48-bc533102bd63 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66892024-12-06T20:51:55.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2622bd3a-e035-42cf-ac48-bc533102bd63 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66902024-12-06T20:51:55.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2622bd3a-e035-42cf-ac48-bc533102bd63 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66912024-12-06T20:51:56.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8e24f201-6430-44d5-aa95-ba0d4e53197f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66922024-12-06T20:51:56.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8e24f201-6430-44d5-aa95-ba0d4e53197f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66932024-12-06T20:51:56.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8e24f201-6430-44d5-aa95-ba0d4e53197f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66942024-12-06T20:51:57.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b0390c77-e32b-4f6b-ae1f-a32f88367e56 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66952024-12-06T20:51:57.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b0390c77-e32b-4f6b-ae1f-a32f88367e56 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66962024-12-06T20:51:57.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b0390c77-e32b-4f6b-ae1f-a32f88367e56 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66972024-12-06T20:51:58.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fa23a3ab-7571-4130-ba61-b83b109b7172 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66982024-12-06T20:51:58.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fa23a3ab-7571-4130-ba61-b83b109b7172 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
66992024-12-06T20:51:58.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fa23a3ab-7571-4130-ba61-b83b109b7172 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
67002024-12-06T20:51:58.852ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
67012024-12-06T20:51:58.852ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67022024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67032024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
67042024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67052024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
67062024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67072024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
67082024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
67092024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
67102024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67112024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67122024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67132024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
67142024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67152024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
67162024-12-06T20:51:58.853ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67172024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
67182024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67192024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
67202024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67212024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
67222024-12-06T20:51:58.854ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67232024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
67242024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67252024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
67262024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
67272024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
67282024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67292024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67302024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67312024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67322024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
67332024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67342024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
67352024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67362024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67372024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67382024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67392024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67402024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67412024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67422024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67432024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67442024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67452024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67462024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67472024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67482024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67492024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67502024-12-06T20:51:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67512024-12-06T20:51:58.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6649, tv_nsec: 194531441 } })
67522024-12-06T20:51:58.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
67532024-12-06T20:51:58.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67542024-12-06T20:51:58.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67552024-12-06T20:51:58.857ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.984853ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67562024-12-06T20:51:58.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67572024-12-06T20:51:58.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67582024-12-06T20:51:58.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67592024-12-06T20:51:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67602024-12-06T20:51:58.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67612024-12-06T20:51:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67622024-12-06T20:51:58.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67632024-12-06T20:51:58.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67642024-12-06T20:51:58.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67652024-12-06T20:51:58.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67662024-12-06T20:51:58.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6649, tv_nsec: 211159790 } })
67672024-12-06T20:51:58.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
67682024-12-06T20:51:58.873ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6649, tv_nsec: 212890155 } })
67692024-12-06T20:51:58.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67702024-12-06T20:51:58.874ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
67712024-12-06T20:51:58.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67722024-12-06T20:51:58.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67732024-12-06T20:51:58.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67742024-12-06T20:51:58.879ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67752024-12-06T20:51:58.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67762024-12-06T20:51:58.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.306885ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
67772024-12-06T20:51:58.916ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67782024-12-06T20:51:58.916ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67792024-12-06T20:51:58.916ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67802024-12-06T20:51:58.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67812024-12-06T20:51:58.917ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67822024-12-06T20:51:58.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67832024-12-06T20:51:58.919ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67842024-12-06T20:51:58.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67852024-12-06T20:51:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67862024-12-06T20:51:58.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67872024-12-06T20:51:58.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67882024-12-06T20:51:58.922ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67892024-12-06T20:51:58.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67902024-12-06T20:51:58.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67912024-12-06T20:51:58.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67922024-12-06T20:51:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67932024-12-06T20:51:58.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67942024-12-06T20:51:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67952024-12-06T20:51:58.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67962024-12-06T20:51:58.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67972024-12-06T20:51:58.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67982024-12-06T20:51:58.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.962181ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
67992024-12-06T20:51:58.927ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68002024-12-06T20:51:58.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68012024-12-06T20:51:58.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68022024-12-06T20:51:58.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68032024-12-06T20:51:58.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68042024-12-06T20:51:58.930ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68052024-12-06T20:51:58.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68062024-12-06T20:51:58.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68072024-12-06T20:51:58.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68082024-12-06T20:51:58.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68092024-12-06T20:51:58.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
68102024-12-06T20:51:58.933ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68112024-12-06T20:51:58.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68122024-12-06T20:51:58.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68132024-12-06T20:51:58.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.537607ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68142024-12-06T20:51:58.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
68152024-12-06T20:51:58.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68162024-12-06T20:51:58.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68172024-12-06T20:51:58.935ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.081476ms iteration = 16 status = 0
68182024-12-06T20:51:58.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68192024-12-06T20:51:58.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68202024-12-06T20:51:58.941ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68212024-12-06T20:51:58.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68222024-12-06T20:51:58.945ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.682064ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
68232024-12-06T20:51:58.950ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68242024-12-06T20:51:58.950ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68252024-12-06T20:51:58.950ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dac8373-722c-4f0d-87fa-fd190946614f", "content-length": "26", "date": "Fri, 06 Dec 2024 20:51:58 GMT"} })
68262024-12-06T20:51:58.950ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68272024-12-06T20:51:58.952ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68282024-12-06T20:51:58.957ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
68292024-12-06T20:51:58.957ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 103.718394ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
68302024-12-06T20:51:58.962ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68312024-12-06T20:51:58.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68322024-12-06T20:51:58.963ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68332024-12-06T20:51:58.963ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68342024-12-06T20:51:58.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68352024-12-06T20:51:58.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68362024-12-06T20:51:58.974ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68372024-12-06T20:51:58.974ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 120.410684ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68382024-12-06T20:51:58.974ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.761274ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68392024-12-06T20:51:58.977ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68402024-12-06T20:51:58.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68412024-12-06T20:51:58.979ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68422024-12-06T20:51:58.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68432024-12-06T20:51:59.000ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.345043ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
68442024-12-06T20:51:59.001ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68452024-12-06T20:51:59.001ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68462024-12-06T20:51:59.001ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.204935ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68472024-12-06T20:51:59.022ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68482024-12-06T20:51:59.022ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68492024-12-06T20:51:59.022ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad7378f4-2289-42ff-b3ea-76e359d0a057", "content-length": "26", "date": "Fri, 06 Dec 2024 20:51:58 GMT"} })
68502024-12-06T20:51:59.022ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68512024-12-06T20:51:59.024ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68522024-12-06T20:51:59.028ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68532024-12-06T20:51:59.028ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ae935b4-e6d2-4ae7-8b5c-923baf2432b1", "content-length": "1", "date": "Fri, 06 Dec 2024 20:51:58 GMT"} })
68542024-12-06T20:51:59.029ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68552024-12-06T20:51:59.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68562024-12-06T20:51:59.031ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 179.140429ms iteration = 16 status = null
68572024-12-06T20:51:59.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68582024-12-06T20:51:59.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68592024-12-06T20:51:59.053ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
68602024-12-06T20:51:59.053ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68612024-12-06T20:51:59.053ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5091347-fa1f-459f-94fb-6a6fa19f210e", "content-length": "26", "date": "Fri, 06 Dec 2024 20:51:58 GMT"} })
68622024-12-06T20:51:59.053ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68632024-12-06T20:51:59.055ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
68642024-12-06T20:51:59.081ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68652024-12-06T20:51:59.081ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68662024-12-06T20:51:59.082ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "301356db-1f27-48e8-b6a7-da23306a4a9b", "content-length": "372", "date": "Fri, 06 Dec 2024 20:51:59 GMT"} })
68672024-12-06T20:51:59.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68682024-12-06T20:51:59.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68692024-12-06T20:51:59.083ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68702024-12-06T20:51:59.084ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 230.451212ms iteration = 18 status = {"physical_disks_added":0}
68712024-12-06T20:51:59.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68722024-12-06T20:51:59.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68732024-12-06T20:51:59.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68742024-12-06T20:51:59.086ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 232.685029ms iteration = 16 status = {}
68752024-12-06T20:51:59.121ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68762024-12-06T20:51:59.123ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68772024-12-06T20:51:59.123ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68782024-12-06T20:51:59.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68792024-12-06T20:51:59.141ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
68802024-12-06T20:51:59.141ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68812024-12-06T20:51:59.141ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2bb64102-0bad-42d5-8011-de2a48994486", "date": "Fri, 06 Dec 2024 20:51:59 GMT"} })
68822024-12-06T20:51:59.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68832024-12-06T20:51:59.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68842024-12-06T20:51:59.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68852024-12-06T20:51:59.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68862024-12-06T20:51:59.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68872024-12-06T20:51:59.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68882024-12-06T20:51:59.150ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68892024-12-06T20:51:59.150ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68902024-12-06T20:51:59.150ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9e4846fb-faf1-452e-9115-fcca93892009", "date": "Fri, 06 Dec 2024 20:51:59 GMT"} })
68912024-12-06T20:51:59.153ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 299.165603ms iteration = 16 status = {}
68922024-12-06T20:51:59.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e072ce4c-1e65-4bb0-ba15-1559d65c7831 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
68932024-12-06T20:51:59.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e072ce4c-1e65-4bb0-ba15-1559d65c7831 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
68942024-12-06T20:51:59.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e072ce4c-1e65-4bb0-ba15-1559d65c7831 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
68952024-12-06T20:51:59.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68962024-12-06T20:51:59.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68972024-12-06T20:51:59.174ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
68982024-12-06T20:51:59.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68992024-12-06T20:51:59.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69002024-12-06T20:51:59.186ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69012024-12-06T20:51:59.186ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "707475fd-7ebe-4538-b319-47fa4f2f4079", "content-length": "134", "date": "Fri, 06 Dec 2024 20:51:58 GMT"} })
69022024-12-06T20:51:59.186ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69032024-12-06T20:51:59.186ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
69042024-12-06T20:51:59.187ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69052024-12-06T20:51:59.187ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69062024-12-06T20:51:59.187ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69072024-12-06T20:51:59.187ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69082024-12-06T20:51:59.187ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69092024-12-06T20:51:59.187ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69102024-12-06T20:51:59.187ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69112024-12-06T20:51:59.187ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69122024-12-06T20:51:59.187ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
69132024-12-06T20:51:59.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69142024-12-06T20:51:59.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69152024-12-06T20:51:59.220ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69162024-12-06T20:51:59.221ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69172024-12-06T20:51:59.221ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fdcd034-3c0d-4cb0-811b-d10658a8add4", "content-length": "2", "date": "Fri, 06 Dec 2024 20:51:58 GMT"} })
69182024-12-06T20:51:59.221ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69192024-12-06T20:51:59.221ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "98931294-0faf-4e2d-82f1-b5112f2150ba", "content-length": "52", "date": "Fri, 06 Dec 2024 20:51:58 GMT"} })
69202024-12-06T20:51:59.221ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
69212024-12-06T20:51:59.221ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69222024-12-06T20:51:59.298ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8a4494e-63a7-47b6-9750-17a28932d3c7", "content-length": "691", "date": "Fri, 06 Dec 2024 20:51:59 GMT"} })
69232024-12-06T20:51:59.298ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
69242024-12-06T20:51:59.298ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
69252024-12-06T20:51:59.298ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
69262024-12-06T20:51:59.300ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 446.564162ms iteration = 16 status = {}
69272024-12-06T20:51:59.387ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f3f31e6b-cd69-4e25-89d7-4fad6d10dd48", "date": "Fri, 06 Dec 2024 20:51:59 GMT"} })
69282024-12-06T20:51:59.387ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
69292024-12-06T20:51:59.387ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69302024-12-06T20:51:59.388ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "46371b17-69a4-44eb-9cd8-825bd21e9e43", "content-length": "682", "date": "Fri, 06 Dec 2024 20:51:59 GMT"} })
69312024-12-06T20:51:59.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69322024-12-06T20:51:59.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69332024-12-06T20:51:59.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69342024-12-06T20:51:59.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69352024-12-06T20:51:59.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69362024-12-06T20:51:59.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69372024-12-06T20:51:59.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69382024-12-06T20:51:59.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69392024-12-06T20:51:59.404ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 550.248386ms iteration = 16 status = {}
69402024-12-06T20:52:00.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f5b0e583-0c79-4718-b307-5ff1f6cdce3b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69412024-12-06T20:52:00.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f5b0e583-0c79-4718-b307-5ff1f6cdce3b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69422024-12-06T20:52:00.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f5b0e583-0c79-4718-b307-5ff1f6cdce3b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69432024-12-06T20:52:01.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e4f6af91-bae1-4568-b75d-dae2c027a1e9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69442024-12-06T20:52:01.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e4f6af91-bae1-4568-b75d-dae2c027a1e9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69452024-12-06T20:52:01.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e4f6af91-bae1-4568-b75d-dae2c027a1e9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69462024-12-06T20:52:02.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 57311b53-e393-430c-97c8-f56b63c16a97 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69472024-12-06T20:52:02.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 57311b53-e393-430c-97c8-f56b63c16a97 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69482024-12-06T20:52:02.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 57311b53-e393-430c-97c8-f56b63c16a97 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69492024-12-06T20:52:02.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 449 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = cb536375-c444-4a9b-98bc-de5a89641a2b response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
69502024-12-06T20:52:03.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5deaa2f8-efcf-440b-93bd-7d5d43b17471 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69512024-12-06T20:52:03.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5deaa2f8-efcf-440b-93bd-7d5d43b17471 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69522024-12-06T20:52:03.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5deaa2f8-efcf-440b-93bd-7d5d43b17471 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69532024-12-06T20:52:04.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6fe50e3e-3eea-4f39-8b49-0441a12117be roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69542024-12-06T20:52:04.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6fe50e3e-3eea-4f39-8b49-0441a12117be resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69552024-12-06T20:52:04.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6fe50e3e-3eea-4f39-8b49-0441a12117be response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69562024-12-06T20:52:05.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6f488b0c-bb83-435f-9642-4ec863201967 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69572024-12-06T20:52:05.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6f488b0c-bb83-435f-9642-4ec863201967 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69582024-12-06T20:52:05.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6f488b0c-bb83-435f-9642-4ec863201967 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69592024-12-06T20:52:06.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce3f61b8-467a-4d2c-b0c3-60a36b15f057 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69602024-12-06T20:52:06.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce3f61b8-467a-4d2c-b0c3-60a36b15f057 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69612024-12-06T20:52:06.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce3f61b8-467a-4d2c-b0c3-60a36b15f057 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69622024-12-06T20:52:07.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1c2068fd-23b1-4431-ba75-d7eb1c44dd4b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69632024-12-06T20:52:07.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1c2068fd-23b1-4431-ba75-d7eb1c44dd4b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69642024-12-06T20:52:07.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1c2068fd-23b1-4431-ba75-d7eb1c44dd4b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69652024-12-06T20:52:08.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7991f209-4333-4f49-97e5-1b857ab99009 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69662024-12-06T20:52:08.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7991f209-4333-4f49-97e5-1b857ab99009 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69672024-12-06T20:52:08.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7991f209-4333-4f49-97e5-1b857ab99009 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69682024-12-06T20:52:08.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
69692024-12-06T20:52:08.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
69702024-12-06T20:52:08.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69712024-12-06T20:52:08.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69722024-12-06T20:52:08.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69732024-12-06T20:52:08.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69742024-12-06T20:52:08.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69752024-12-06T20:52:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69762024-12-06T20:52:08.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69772024-12-06T20:52:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69782024-12-06T20:52:08.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69792024-12-06T20:52:08.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69802024-12-06T20:52:08.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69812024-12-06T20:52:08.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
69822024-12-06T20:52:08.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69832024-12-06T20:52:08.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69842024-12-06T20:52:08.878ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
69852024-12-06T20:52:08.878ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.563713ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
69862024-12-06T20:52:08.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69872024-12-06T20:52:08.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69882024-12-06T20:52:08.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.054037ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69892024-12-06T20:52:09.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b58f5a6e-a8c9-4939-b4ca-811bf33fb835 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69902024-12-06T20:52:09.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b58f5a6e-a8c9-4939-b4ca-811bf33fb835 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69912024-12-06T20:52:09.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b58f5a6e-a8c9-4939-b4ca-811bf33fb835 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69922024-12-06T20:52:10.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 932ca011-70a3-4507-aa9d-da3e5b1ab2db roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69932024-12-06T20:52:10.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 932ca011-70a3-4507-aa9d-da3e5b1ab2db resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69942024-12-06T20:52:10.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 932ca011-70a3-4507-aa9d-da3e5b1ab2db response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69952024-12-06T20:52:11.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6168d369-ff68-43bc-aaf3-00564d216582 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69962024-12-06T20:52:11.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6168d369-ff68-43bc-aaf3-00564d216582 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69972024-12-06T20:52:11.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6168d369-ff68-43bc-aaf3-00564d216582 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
69982024-12-06T20:52:12.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 442 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 631d9be1-a23e-4f15-9e0f-20139f770702 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
69992024-12-06T20:52:12.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1315f5aa-6356-488f-876c-809655329253 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70002024-12-06T20:52:12.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1315f5aa-6356-488f-876c-809655329253 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70012024-12-06T20:52:12.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1315f5aa-6356-488f-876c-809655329253 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70022024-12-06T20:52:13.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 906b4c7b-e832-48b3-82ef-e58022f7a69b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70032024-12-06T20:52:13.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 906b4c7b-e832-48b3-82ef-e58022f7a69b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70042024-12-06T20:52:13.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 906b4c7b-e832-48b3-82ef-e58022f7a69b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70052024-12-06T20:52:14.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc24877f-9048-43ae-ac76-9fbcf9b79118 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70062024-12-06T20:52:14.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc24877f-9048-43ae-ac76-9fbcf9b79118 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70072024-12-06T20:52:14.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc24877f-9048-43ae-ac76-9fbcf9b79118 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70082024-12-06T20:52:15.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 93ad05ac-8293-4d69-87da-771a38986054 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70092024-12-06T20:52:15.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 93ad05ac-8293-4d69-87da-771a38986054 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70102024-12-06T20:52:15.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 93ad05ac-8293-4d69-87da-771a38986054 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70112024-12-06T20:52:16.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 56052f90-df3b-4309-93ed-5ac499b13165 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70122024-12-06T20:52:16.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 56052f90-df3b-4309-93ed-5ac499b13165 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70132024-12-06T20:52:16.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 56052f90-df3b-4309-93ed-5ac499b13165 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70142024-12-06T20:52:17.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2e4b6f7a-7864-4e77-927a-9046db104d34 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70152024-12-06T20:52:17.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2e4b6f7a-7864-4e77-927a-9046db104d34 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70162024-12-06T20:52:17.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2e4b6f7a-7864-4e77-927a-9046db104d34 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70172024-12-06T20:52:18.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 94292484-b26b-43ef-8ee4-e1de7a641dd7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70182024-12-06T20:52:18.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 94292484-b26b-43ef-8ee4-e1de7a641dd7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70192024-12-06T20:52:18.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 94292484-b26b-43ef-8ee4-e1de7a641dd7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70202024-12-06T20:52:18.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
70212024-12-06T20:52:18.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
70222024-12-06T20:52:18.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70232024-12-06T20:52:18.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70242024-12-06T20:52:18.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70252024-12-06T20:52:18.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70262024-12-06T20:52:18.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70272024-12-06T20:52:18.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70282024-12-06T20:52:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70292024-12-06T20:52:18.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70302024-12-06T20:52:18.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70312024-12-06T20:52:18.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70322024-12-06T20:52:18.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70332024-12-06T20:52:18.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70342024-12-06T20:52:18.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.403424ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70352024-12-06T20:52:18.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70362024-12-06T20:52:18.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
70372024-12-06T20:52:18.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70382024-12-06T20:52:18.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70392024-12-06T20:52:18.907ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
70402024-12-06T20:52:18.907ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.823368ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
70412024-12-06T20:52:19.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ae358105-b2c8-48b4-9ba1-62a2e949891c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70422024-12-06T20:52:19.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ae358105-b2c8-48b4-9ba1-62a2e949891c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70432024-12-06T20:52:19.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ae358105-b2c8-48b4-9ba1-62a2e949891c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70442024-12-06T20:52:20.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aa969139-bbfd-49b0-9ab0-7781b42b9291 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70452024-12-06T20:52:20.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aa969139-bbfd-49b0-9ab0-7781b42b9291 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70462024-12-06T20:52:20.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aa969139-bbfd-49b0-9ab0-7781b42b9291 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70472024-12-06T20:52:21.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c915a7e-d385-421e-a6d8-473866294f49 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70482024-12-06T20:52:21.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c915a7e-d385-421e-a6d8-473866294f49 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70492024-12-06T20:52:21.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c915a7e-d385-421e-a6d8-473866294f49 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70502024-12-06T20:52:22.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 439 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 0df19596-d352-4633-a626-b1fd642d123a response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
70512024-12-06T20:52:22.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = db416b79-d3ed-49be-95ca-e7848529c868 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70522024-12-06T20:52:22.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = db416b79-d3ed-49be-95ca-e7848529c868 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70532024-12-06T20:52:22.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = db416b79-d3ed-49be-95ca-e7848529c868 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70542024-12-06T20:52:23.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 54c84ee3-d57a-488a-8556-b19d8e03b22c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70552024-12-06T20:52:23.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 54c84ee3-d57a-488a-8556-b19d8e03b22c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70562024-12-06T20:52:23.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 54c84ee3-d57a-488a-8556-b19d8e03b22c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70572024-12-06T20:52:24.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a28e5bb2-6c89-4d38-b9bc-4a550584bd93 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70582024-12-06T20:52:24.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a28e5bb2-6c89-4d38-b9bc-4a550584bd93 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70592024-12-06T20:52:24.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a28e5bb2-6c89-4d38-b9bc-4a550584bd93 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70602024-12-06T20:52:25.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0844774f-ae7c-4853-ac53-8ad5d445fbaf roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70612024-12-06T20:52:25.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0844774f-ae7c-4853-ac53-8ad5d445fbaf resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70622024-12-06T20:52:25.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0844774f-ae7c-4853-ac53-8ad5d445fbaf response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70632024-12-06T20:52:26.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2e9c274f-70ac-4e7d-97df-1d5fd58b94d5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70642024-12-06T20:52:26.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2e9c274f-70ac-4e7d-97df-1d5fd58b94d5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70652024-12-06T20:52:26.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2e9c274f-70ac-4e7d-97df-1d5fd58b94d5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70662024-12-06T20:52:27.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a910879d-e715-49e5-ac3f-568089625adb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70672024-12-06T20:52:27.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a910879d-e715-49e5-ac3f-568089625adb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70682024-12-06T20:52:27.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a910879d-e715-49e5-ac3f-568089625adb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70692024-12-06T20:52:28.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e2b47f2c-a1ee-4405-9ccc-c69588646172 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70702024-12-06T20:52:28.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e2b47f2c-a1ee-4405-9ccc-c69588646172 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70712024-12-06T20:52:28.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e2b47f2c-a1ee-4405-9ccc-c69588646172 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
70722024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
70732024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70742024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
70752024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
70762024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70772024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
70782024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
70792024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
70802024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70812024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
70822024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
70832024-12-06T20:52:28.853ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:42:28.853301012 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
70842024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
70852024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
70862024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
70872024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70882024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
70892024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
70902024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70912024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
70922024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
70932024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
70942024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70952024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
70962024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70972024-12-06T20:52:28.853ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
70982024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70992024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71002024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
71012024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71022024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
71032024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
71042024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
71052024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71062024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71072024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
71082024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71092024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71102024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
71112024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
71122024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
71132024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
71142024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
71152024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
71162024-12-06T20:52:28.853ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
71172024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
71182024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71192024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
71202024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
71212024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.34\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
71222024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71232024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71242024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71252024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
71262024-12-06T20:52:28.853ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71272024-12-06T20:52:28.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71282024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
71292024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71302024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71312024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
71322024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
71332024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71342024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71352024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
71362024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71372024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
71382024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71392024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71402024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71412024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71422024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71432024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71442024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
71452024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71462024-12-06T20:52:28.854ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6679, tv_nsec: 193611186 } })
71472024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71482024-12-06T20:52:28.854ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6679, tv_nsec: 193649547 } })
71492024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71502024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71512024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
71522024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71532024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71542024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71552024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71562024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71572024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71582024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71592024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71602024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
71612024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.492179ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
71622024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
71632024-12-06T20:52:28.854ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.474518ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
71642024-12-06T20:52:28.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71652024-12-06T20:52:28.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71662024-12-06T20:52:28.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6679, tv_nsec: 195476614 } })
71672024-12-06T20:52:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71682024-12-06T20:52:28.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
71692024-12-06T20:52:28.857ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:42:28.853301012 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
71702024-12-06T20:52:28.857ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.868019ms iteration = 9 status = {"expiration":"2024-12-06T20:42:28.853301012Z","pruned":[]}
71712024-12-06T20:52:28.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71722024-12-06T20:52:28.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71732024-12-06T20:52:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71742024-12-06T20:52:28.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71752024-12-06T20:52:28.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.269146ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71762024-12-06T20:52:28.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71772024-12-06T20:52:28.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71782024-12-06T20:52:28.861ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71792024-12-06T20:52:28.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71802024-12-06T20:52:28.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71812024-12-06T20:52:28.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71822024-12-06T20:52:28.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71832024-12-06T20:52:28.871ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.162118ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
71842024-12-06T20:52:28.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71852024-12-06T20:52:28.875ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6679, tv_nsec: 215341697 } })
71862024-12-06T20:52:28.876ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
71872024-12-06T20:52:28.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71882024-12-06T20:52:28.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71892024-12-06T20:52:28.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71902024-12-06T20:52:28.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71912024-12-06T20:52:28.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71922024-12-06T20:52:28.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71932024-12-06T20:52:28.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71942024-12-06T20:52:28.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71952024-12-06T20:52:28.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71962024-12-06T20:52:28.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71972024-12-06T20:52:28.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71982024-12-06T20:52:28.924ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71992024-12-06T20:52:28.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
72002024-12-06T20:52:28.927ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72012024-12-06T20:52:28.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72022024-12-06T20:52:28.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72032024-12-06T20:52:28.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72042024-12-06T20:52:28.933ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72052024-12-06T20:52:28.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72062024-12-06T20:52:28.934ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72072024-12-06T20:52:28.934ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72082024-12-06T20:52:28.934ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72092024-12-06T20:52:28.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72102024-12-06T20:52:28.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72112024-12-06T20:52:28.936ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 83.02641ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
72122024-12-06T20:52:28.936ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 83.067151ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
72132024-12-06T20:52:28.936ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72142024-12-06T20:52:28.936ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.140494ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72152024-12-06T20:52:28.938ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72162024-12-06T20:52:28.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72172024-12-06T20:52:28.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72182024-12-06T20:52:28.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72192024-12-06T20:52:28.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72202024-12-06T20:52:28.940ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72212024-12-06T20:52:28.941ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72222024-12-06T20:52:28.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72232024-12-06T20:52:28.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72242024-12-06T20:52:28.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72252024-12-06T20:52:28.941ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72262024-12-06T20:52:28.941ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
72272024-12-06T20:52:28.941ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
72282024-12-06T20:52:28.941ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 88.223505ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
72292024-12-06T20:52:28.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72302024-12-06T20:52:28.943ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72312024-12-06T20:52:28.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72322024-12-06T20:52:28.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72332024-12-06T20:52:28.943ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.344379ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72342024-12-06T20:52:28.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72352024-12-06T20:52:28.946ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72362024-12-06T20:52:28.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72372024-12-06T20:52:28.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72382024-12-06T20:52:28.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72392024-12-06T20:52:28.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
72402024-12-06T20:52:28.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72412024-12-06T20:52:28.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72422024-12-06T20:52:28.956ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72432024-12-06T20:52:28.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72442024-12-06T20:52:28.957ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6679, tv_nsec: 297048213 } })
72452024-12-06T20:52:28.958ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
72462024-12-06T20:52:28.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72472024-12-06T20:52:28.959ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72482024-12-06T20:52:28.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72492024-12-06T20:52:28.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72502024-12-06T20:52:28.975ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
72512024-12-06T20:52:28.975ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 121.597525ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
72522024-12-06T20:52:28.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72532024-12-06T20:52:28.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72542024-12-06T20:52:28.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72552024-12-06T20:52:28.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72562024-12-06T20:52:28.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72572024-12-06T20:52:28.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72582024-12-06T20:52:28.996ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72592024-12-06T20:52:28.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72602024-12-06T20:52:28.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72612024-12-06T20:52:28.998ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72622024-12-06T20:52:29.000ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72632024-12-06T20:52:29.000ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72642024-12-06T20:52:29.000ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72652024-12-06T20:52:29.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72662024-12-06T20:52:29.001ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
72672024-12-06T20:52:29.001ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
72682024-12-06T20:52:29.001ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 147.560684ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
72692024-12-06T20:52:29.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72702024-12-06T20:52:29.001ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72712024-12-06T20:52:29.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72722024-12-06T20:52:29.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
72732024-12-06T20:52:29.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72742024-12-06T20:52:29.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72752024-12-06T20:52:29.003ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72762024-12-06T20:52:29.004ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 150.89272ms iteration = 17 status = 0
72772024-12-06T20:52:29.004ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
72782024-12-06T20:52:29.004ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
72792024-12-06T20:52:29.004ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
72802024-12-06T20:52:29.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72812024-12-06T20:52:29.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72822024-12-06T20:52:29.007ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
72832024-12-06T20:52:29.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72842024-12-06T20:52:29.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 154.598105ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72852024-12-06T20:52:29.008ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
72862024-12-06T20:52:29.008ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72872024-12-06T20:52:29.009ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cde4cd46-6097-4c25-b3bb-eda7c55d91db", "content-length": "26", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} })
72882024-12-06T20:52:29.009ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72892024-12-06T20:52:29.009ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72902024-12-06T20:52:29.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72912024-12-06T20:52:29.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72922024-12-06T20:52:29.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72932024-12-06T20:52:29.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72942024-12-06T20:52:29.012ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72952024-12-06T20:52:29.012ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
72962024-12-06T20:52:29.012ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72972024-12-06T20:52:29.012ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03d10339-5b9f-454b-835c-19a6037e8175", "content-length": "26", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} })
72982024-12-06T20:52:29.012ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72992024-12-06T20:52:29.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73002024-12-06T20:52:29.016ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73012024-12-06T20:52:29.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 162.715374ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
73022024-12-06T20:52:29.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73032024-12-06T20:52:29.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73042024-12-06T20:52:29.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73052024-12-06T20:52:29.018ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73062024-12-06T20:52:29.018ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
73072024-12-06T20:52:29.018ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
73082024-12-06T20:52:29.018ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
73092024-12-06T20:52:29.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73102024-12-06T20:52:29.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73112024-12-06T20:52:29.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73122024-12-06T20:52:29.020ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73132024-12-06T20:52:29.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73142024-12-06T20:52:29.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73152024-12-06T20:52:29.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73162024-12-06T20:52:29.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73172024-12-06T20:52:29.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73182024-12-06T20:52:29.037ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
73192024-12-06T20:52:29.037ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
73202024-12-06T20:52:29.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73212024-12-06T20:52:29.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73222024-12-06T20:52:29.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73232024-12-06T20:52:29.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73242024-12-06T20:52:29.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73252024-12-06T20:52:29.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73262024-12-06T20:52:29.046ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
73272024-12-06T20:52:29.046ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
73282024-12-06T20:52:29.046ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
73292024-12-06T20:52:29.046ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 193.492348ms iteration = 9 status = {"generation":2}
73302024-12-06T20:52:29.054ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) }
73312024-12-06T20:52:29.054ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 201.331261ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
73322024-12-06T20:52:29.058ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73332024-12-06T20:52:29.058ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73342024-12-06T20:52:29.058ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 204.470642ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73352024-12-06T20:52:29.062ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
73362024-12-06T20:52:29.062ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
73372024-12-06T20:52:29.062ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73382024-12-06T20:52:29.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73392024-12-06T20:52:29.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73402024-12-06T20:52:29.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73412024-12-06T20:52:29.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73422024-12-06T20:52:29.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73432024-12-06T20:52:29.069ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 215.623919ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
73442024-12-06T20:52:29.071ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
73452024-12-06T20:52:29.072ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
73462024-12-06T20:52:29.072ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
73472024-12-06T20:52:29.072ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 218.7848ms iteration = 9 status = {"generation":1}
73482024-12-06T20:52:29.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73492024-12-06T20:52:29.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73502024-12-06T20:52:29.080ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
73512024-12-06T20:52:29.080ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 227.012233ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
73522024-12-06T20:52:29.133ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
73532024-12-06T20:52:29.133ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73542024-12-06T20:52:29.134ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02552269-6f53-4943-b6ab-de3ec6f102bb", "content-length": "26", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} })
73552024-12-06T20:52:29.134ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73562024-12-06T20:52:29.136ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
73572024-12-06T20:52:29.139ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 285.735947ms iteration = 19 status = {"physical_disks_added":0}
73582024-12-06T20:52:29.163ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73592024-12-06T20:52:29.164ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0bd6661-8c4f-4ea8-84c2-c63d02fe09d5", "content-length": "1", "date": "Fri, 06 Dec 2024 20:52:28 GMT"} })
73602024-12-06T20:52:29.165ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73612024-12-06T20:52:29.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73622024-12-06T20:52:29.167ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 314.240091ms iteration = 17 status = null
73632024-12-06T20:52:29.170ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
73642024-12-06T20:52:29.170ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ad41a342-04f9-4c40-906c-000489428f56", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73652024-12-06T20:52:29.170ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73662024-12-06T20:52:29.172ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b7e7cd99-104e-40d1-9e6f-b05c54b8ac12", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73672024-12-06T20:52:29.172ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73682024-12-06T20:52:29.174ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
73692024-12-06T20:52:29.174ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 320.981845ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
73702024-12-06T20:52:29.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73712024-12-06T20:52:29.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73722024-12-06T20:52:29.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73732024-12-06T20:52:29.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73742024-12-06T20:52:29.179ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73752024-12-06T20:52:29.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73762024-12-06T20:52:29.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73772024-12-06T20:52:29.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73782024-12-06T20:52:29.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73792024-12-06T20:52:29.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73802024-12-06T20:52:29.231ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73812024-12-06T20:52:29.231ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73822024-12-06T20:52:29.232ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c33eb4b-9ffd-46e2-8336-ea3a243f3c5c", "content-length": "372", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} })
73832024-12-06T20:52:29.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73842024-12-06T20:52:29.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73852024-12-06T20:52:29.260ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 406.448198ms iteration = 17 status = {}
73862024-12-06T20:52:29.263ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
73872024-12-06T20:52:29.278ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
73882024-12-06T20:52:29.278ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73892024-12-06T20:52:29.279ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8711da53-c5ed-4157-8ca4-fd39af01eecb", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} })
73902024-12-06T20:52:29.279ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73912024-12-06T20:52:29.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73922024-12-06T20:52:29.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73932024-12-06T20:52:29.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73942024-12-06T20:52:29.286ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73952024-12-06T20:52:29.286ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e566fbda-3940-4bf9-a393-d2c431034ecc", "content-length": "691", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} })
73962024-12-06T20:52:29.286ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
73972024-12-06T20:52:29.286ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
73982024-12-06T20:52:29.286ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
73992024-12-06T20:52:29.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74002024-12-06T20:52:29.288ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 434.44871ms iteration = 17 status = {}
74012024-12-06T20:52:29.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74022024-12-06T20:52:29.291ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74032024-12-06T20:52:29.291ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74042024-12-06T20:52:29.294ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "487ba30a-debd-484a-8a3d-44635bbe4496", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} })
74052024-12-06T20:52:29.296ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 443.009101ms iteration = 17 status = {}
74062024-12-06T20:52:29.327ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
74072024-12-06T20:52:29.328ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7ef388f7-4e2f-41ee-9b9b-3df66821d4ed", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74082024-12-06T20:52:29.328ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74092024-12-06T20:52:29.329ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a463403d-1bed-4775-8b89-295dda9daba8", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74102024-12-06T20:52:29.329ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74112024-12-06T20:52:29.331ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a6a3a7f9-c806-4ecb-8810-4ab191e5d26c", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74122024-12-06T20:52:29.331ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74132024-12-06T20:52:29.334ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
74142024-12-06T20:52:29.334ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 481.116113ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
74152024-12-06T20:52:29.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74162024-12-06T20:52:29.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74172024-12-06T20:52:29.367ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
74182024-12-06T20:52:29.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74192024-12-06T20:52:29.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74202024-12-06T20:52:29.375ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74212024-12-06T20:52:29.375ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "40f0db7e-410a-499c-9f50-f19738eff884", "content-length": "134", "date": "Fri, 06 Dec 2024 20:52:28 GMT"} })
74222024-12-06T20:52:29.375ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
74232024-12-06T20:52:29.375ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
74242024-12-06T20:52:29.375ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74252024-12-06T20:52:29.375ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74262024-12-06T20:52:29.375ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74272024-12-06T20:52:29.375ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74282024-12-06T20:52:29.375ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74292024-12-06T20:52:29.375ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74302024-12-06T20:52:29.376ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74312024-12-06T20:52:29.376ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74322024-12-06T20:52:29.376ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
74332024-12-06T20:52:29.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74342024-12-06T20:52:29.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74352024-12-06T20:52:29.378ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74362024-12-06T20:52:29.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f598867-a5f1-4f06-8dc9-02f9737eeff8", "content-length": "2", "date": "Fri, 06 Dec 2024 20:52:28 GMT"} })
74372024-12-06T20:52:29.378ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74382024-12-06T20:52:29.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f3cd045-c1f2-467f-9faa-7edd3363076f", "content-length": "52", "date": "Fri, 06 Dec 2024 20:52:28 GMT"} })
74392024-12-06T20:52:29.378ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
74402024-12-06T20:52:29.378ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74412024-12-06T20:52:29.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b6aa2b2a-963f-4212-b138-d3660758394d", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} })
74422024-12-06T20:52:29.473ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
74432024-12-06T20:52:29.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74442024-12-06T20:52:29.476ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "abb708b4-044d-443f-b95d-28c45cfa0c1c", "content-length": "682", "date": "Fri, 06 Dec 2024 20:52:29 GMT"} })
74452024-12-06T20:52:29.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74462024-12-06T20:52:29.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74472024-12-06T20:52:29.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74482024-12-06T20:52:29.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74492024-12-06T20:52:29.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74502024-12-06T20:52:29.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74512024-12-06T20:52:29.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74522024-12-06T20:52:29.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74532024-12-06T20:52:29.493ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 640.42273ms iteration = 17 status = {}
74542024-12-06T20:52:29.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9769f0f2-a312-4f56-93f3-2d45ef1171ea roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74552024-12-06T20:52:29.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9769f0f2-a312-4f56-93f3-2d45ef1171ea resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74562024-12-06T20:52:29.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9769f0f2-a312-4f56-93f3-2d45ef1171ea response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74572024-12-06T20:52:30.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 141cddc8-0baa-4b2e-ab90-570c9984883d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74582024-12-06T20:52:30.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 141cddc8-0baa-4b2e-ab90-570c9984883d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74592024-12-06T20:52:30.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 141cddc8-0baa-4b2e-ab90-570c9984883d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74602024-12-06T20:52:31.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e849900f-c909-44b1-b4f3-8e1ac7f3c353 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74612024-12-06T20:52:31.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e849900f-c909-44b1-b4f3-8e1ac7f3c353 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74622024-12-06T20:52:31.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e849900f-c909-44b1-b4f3-8e1ac7f3c353 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74632024-12-06T20:52:32.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 456 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 9b8a0482-63bc-478b-88fd-aab4a01934c3 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
74642024-12-06T20:52:32.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9ac307f9-3f60-44e8-9a1b-bd4af6aa5143 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74652024-12-06T20:52:32.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9ac307f9-3f60-44e8-9a1b-bd4af6aa5143 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74662024-12-06T20:52:32.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9ac307f9-3f60-44e8-9a1b-bd4af6aa5143 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74672024-12-06T20:52:33.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4df8eb86-066c-48b7-acb8-7d384f72a8dc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74682024-12-06T20:52:33.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4df8eb86-066c-48b7-acb8-7d384f72a8dc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74692024-12-06T20:52:33.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4df8eb86-066c-48b7-acb8-7d384f72a8dc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74702024-12-06T20:52:34.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 44d2bb5f-a0c7-43fa-bba5-0a8dc179cf22 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74712024-12-06T20:52:34.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 44d2bb5f-a0c7-43fa-bba5-0a8dc179cf22 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74722024-12-06T20:52:34.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 44d2bb5f-a0c7-43fa-bba5-0a8dc179cf22 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74732024-12-06T20:52:35.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 41f8746e-5e4f-435b-a41f-e367a6cf7742 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74742024-12-06T20:52:35.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 41f8746e-5e4f-435b-a41f-e367a6cf7742 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74752024-12-06T20:52:35.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 41f8746e-5e4f-435b-a41f-e367a6cf7742 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74762024-12-06T20:52:36.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 00f151a1-70d9-4f12-9ca2-587e7e54cac6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74772024-12-06T20:52:36.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 00f151a1-70d9-4f12-9ca2-587e7e54cac6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74782024-12-06T20:52:36.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 00f151a1-70d9-4f12-9ca2-587e7e54cac6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74792024-12-06T20:52:37.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eaf26b9b-2803-4925-931e-b82f3986c09d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74802024-12-06T20:52:37.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eaf26b9b-2803-4925-931e-b82f3986c09d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74812024-12-06T20:52:37.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eaf26b9b-2803-4925-931e-b82f3986c09d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
74822024-12-06T20:52:38.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
74832024-12-06T20:52:38.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
74842024-12-06T20:52:38.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74852024-12-06T20:52:38.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74862024-12-06T20:52:38.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74872024-12-06T20:52:38.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74882024-12-06T20:52:38.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74892024-12-06T20:52:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74902024-12-06T20:52:38.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74912024-12-06T20:52:38.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74922024-12-06T20:52:38.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74932024-12-06T20:52:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74942024-12-06T20:52:38.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74952024-12-06T20:52:38.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
74962024-12-06T20:52:38.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74972024-12-06T20:52:38.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74982024-12-06T20:52:38.876ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
74992024-12-06T20:52:38.876ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.50091ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
75002024-12-06T20:52:38.887ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75012024-12-06T20:52:38.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75022024-12-06T20:52:38.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.424933ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75032024-12-06T20:52:39.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d11825a0-b329-4d5c-8344-4d0dccc1971d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75042024-12-06T20:52:39.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d11825a0-b329-4d5c-8344-4d0dccc1971d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75052024-12-06T20:52:39.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d11825a0-b329-4d5c-8344-4d0dccc1971d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75062024-12-06T20:52:40.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 85164dac-7eeb-4bbe-a949-278da4177648 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75072024-12-06T20:52:40.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 85164dac-7eeb-4bbe-a949-278da4177648 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75082024-12-06T20:52:40.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 85164dac-7eeb-4bbe-a949-278da4177648 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75092024-12-06T20:52:41.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4c5f4408-bbdd-4d5c-9eb9-2be1001a89be roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75102024-12-06T20:52:41.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4c5f4408-bbdd-4d5c-9eb9-2be1001a89be resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75112024-12-06T20:52:41.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4c5f4408-bbdd-4d5c-9eb9-2be1001a89be response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75122024-12-06T20:52:42.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e9ab476f-b4e4-414d-a70b-1978ccdb7c33 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75132024-12-06T20:52:42.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e9ab476f-b4e4-414d-a70b-1978ccdb7c33 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75142024-12-06T20:52:42.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e9ab476f-b4e4-414d-a70b-1978ccdb7c33 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75152024-12-06T20:52:42.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = c5327ee9-adb0-46b8-8495-7c08af9cee6a response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
75162024-12-06T20:52:43.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb782d98-67de-486a-9ddf-9de332cb4018 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75172024-12-06T20:52:43.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb782d98-67de-486a-9ddf-9de332cb4018 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75182024-12-06T20:52:43.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb782d98-67de-486a-9ddf-9de332cb4018 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75192024-12-06T20:52:44.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 36e11258-e37a-4cf9-8126-53098d67593a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75202024-12-06T20:52:44.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 36e11258-e37a-4cf9-8126-53098d67593a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75212024-12-06T20:52:44.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 36e11258-e37a-4cf9-8126-53098d67593a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75222024-12-06T20:52:45.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d186984-5c80-4ff1-94c0-a9f2e05c73e0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75232024-12-06T20:52:45.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d186984-5c80-4ff1-94c0-a9f2e05c73e0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75242024-12-06T20:52:45.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d186984-5c80-4ff1-94c0-a9f2e05c73e0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75252024-12-06T20:52:46.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3c69a48a-8ee6-4bac-9594-a4e719dda0ea roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75262024-12-06T20:52:46.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3c69a48a-8ee6-4bac-9594-a4e719dda0ea resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75272024-12-06T20:52:46.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3c69a48a-8ee6-4bac-9594-a4e719dda0ea response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75282024-12-06T20:52:47.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f0ef2f34-57b1-4f80-a6ba-0ae9aa909771 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75292024-12-06T20:52:47.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f0ef2f34-57b1-4f80-a6ba-0ae9aa909771 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75302024-12-06T20:52:47.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f0ef2f34-57b1-4f80-a6ba-0ae9aa909771 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75312024-12-06T20:52:48.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e3f0c94-df7f-49c4-8a9e-f55f69f74129 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75322024-12-06T20:52:48.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e3f0c94-df7f-49c4-8a9e-f55f69f74129 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75332024-12-06T20:52:48.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e3f0c94-df7f-49c4-8a9e-f55f69f74129 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75342024-12-06T20:52:48.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
75352024-12-06T20:52:48.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
75362024-12-06T20:52:48.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75372024-12-06T20:52:48.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75382024-12-06T20:52:48.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75392024-12-06T20:52:48.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75402024-12-06T20:52:48.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75412024-12-06T20:52:48.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75422024-12-06T20:52:48.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75432024-12-06T20:52:48.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75442024-12-06T20:52:48.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75452024-12-06T20:52:48.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75462024-12-06T20:52:48.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75472024-12-06T20:52:48.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
75482024-12-06T20:52:48.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75492024-12-06T20:52:48.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75502024-12-06T20:52:48.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
75512024-12-06T20:52:48.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.558386ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
75522024-12-06T20:52:48.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75532024-12-06T20:52:48.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75542024-12-06T20:52:48.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.682555ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75552024-12-06T20:52:49.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d663230-cae6-416f-ad06-ad88b3edfa77 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75562024-12-06T20:52:49.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d663230-cae6-416f-ad06-ad88b3edfa77 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75572024-12-06T20:52:49.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d663230-cae6-416f-ad06-ad88b3edfa77 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75582024-12-06T20:52:50.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fe084076-2d9f-4586-99d8-d608528b86af roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75592024-12-06T20:52:50.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fe084076-2d9f-4586-99d8-d608528b86af resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75602024-12-06T20:52:50.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fe084076-2d9f-4586-99d8-d608528b86af response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75612024-12-06T20:52:51.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 00873182-e283-45fd-b149-f80d983d743b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75622024-12-06T20:52:51.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 00873182-e283-45fd-b149-f80d983d743b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75632024-12-06T20:52:51.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 00873182-e283-45fd-b149-f80d983d743b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75642024-12-06T20:52:52.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8051b0e-3915-49db-9ad9-26e535ba8a8e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75652024-12-06T20:52:52.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8051b0e-3915-49db-9ad9-26e535ba8a8e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75662024-12-06T20:52:52.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8051b0e-3915-49db-9ad9-26e535ba8a8e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75672024-12-06T20:52:52.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 487 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = fa3448b1-909a-4af2-9090-7021ea3874de response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
75682024-12-06T20:52:53.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 134ef878-28a6-45e5-bc5f-a44d8841598e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75692024-12-06T20:52:53.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 134ef878-28a6-45e5-bc5f-a44d8841598e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75702024-12-06T20:52:53.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 134ef878-28a6-45e5-bc5f-a44d8841598e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75712024-12-06T20:52:54.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 07a30695-d22b-4074-859c-86b1e94acdbe roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75722024-12-06T20:52:54.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 07a30695-d22b-4074-859c-86b1e94acdbe resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75732024-12-06T20:52:54.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 07a30695-d22b-4074-859c-86b1e94acdbe response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75742024-12-06T20:52:55.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 51cd252d-e9f1-4607-8e67-daead912686f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75752024-12-06T20:52:55.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 51cd252d-e9f1-4607-8e67-daead912686f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75762024-12-06T20:52:55.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 51cd252d-e9f1-4607-8e67-daead912686f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75772024-12-06T20:52:56.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7480c025-4db0-4347-b3f3-b539ff0f3b5e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75782024-12-06T20:52:56.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7480c025-4db0-4347-b3f3-b539ff0f3b5e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75792024-12-06T20:52:56.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7480c025-4db0-4347-b3f3-b539ff0f3b5e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75802024-12-06T20:52:57.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8c3c1468-0660-4cae-a8a9-f831c9b53088 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75812024-12-06T20:52:57.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8c3c1468-0660-4cae-a8a9-f831c9b53088 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75822024-12-06T20:52:57.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8c3c1468-0660-4cae-a8a9-f831c9b53088 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75832024-12-06T20:52:58.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 52dc9c8a-06e2-4564-aa2d-be6032084ed9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75842024-12-06T20:52:58.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 52dc9c8a-06e2-4564-aa2d-be6032084ed9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75852024-12-06T20:52:58.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 52dc9c8a-06e2-4564-aa2d-be6032084ed9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
75862024-12-06T20:52:58.852ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
75872024-12-06T20:52:58.852ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75882024-12-06T20:52:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75892024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
75902024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
75912024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
75922024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75932024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75942024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75952024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75962024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
75972024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
75982024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75992024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
76002024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
76012024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76022024-12-06T20:52:58.853ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76032024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
76042024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76052024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76062024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
76072024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
76082024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76092024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76102024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
76112024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76122024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
76132024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76142024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
76152024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76162024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
76172024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76182024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
76192024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76202024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
76212024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76222024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76232024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76242024-12-06T20:52:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76252024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76262024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76272024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76282024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
76292024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76302024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76312024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76322024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76332024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76342024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76352024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76362024-12-06T20:52:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76372024-12-06T20:52:58.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6709, tv_nsec: 194471177 } })
76382024-12-06T20:52:58.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
76392024-12-06T20:52:58.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76402024-12-06T20:52:58.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6709, tv_nsec: 196754256 } })
76412024-12-06T20:52:58.857ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.963312ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76422024-12-06T20:52:58.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
76432024-12-06T20:52:58.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76442024-12-06T20:52:58.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76452024-12-06T20:52:58.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76462024-12-06T20:52:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76472024-12-06T20:52:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76482024-12-06T20:52:58.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76492024-12-06T20:52:58.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76502024-12-06T20:52:58.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.417596ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
76512024-12-06T20:52:58.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76522024-12-06T20:52:58.867ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76532024-12-06T20:52:58.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76542024-12-06T20:52:58.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76552024-12-06T20:52:58.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76562024-12-06T20:52:58.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76572024-12-06T20:52:58.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76582024-12-06T20:52:58.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76592024-12-06T20:52:58.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76602024-12-06T20:52:58.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76612024-12-06T20:52:58.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76622024-12-06T20:52:58.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76632024-12-06T20:52:58.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76642024-12-06T20:52:58.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76652024-12-06T20:52:58.871ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76662024-12-06T20:52:58.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76672024-12-06T20:52:58.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76682024-12-06T20:52:58.875ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6709, tv_nsec: 214999226 } })
76692024-12-06T20:52:58.875ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
76702024-12-06T20:52:58.877ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76712024-12-06T20:52:58.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76722024-12-06T20:52:58.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76732024-12-06T20:52:58.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76742024-12-06T20:52:58.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76752024-12-06T20:52:58.910ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76762024-12-06T20:52:58.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76772024-12-06T20:52:58.911ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76782024-12-06T20:52:58.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76792024-12-06T20:52:58.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76802024-12-06T20:52:58.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76812024-12-06T20:52:58.914ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76822024-12-06T20:52:58.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76832024-12-06T20:52:58.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76842024-12-06T20:52:58.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76852024-12-06T20:52:58.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76862024-12-06T20:52:58.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76872024-12-06T20:52:58.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.868686ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
76882024-12-06T20:52:58.917ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76892024-12-06T20:52:58.917ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
76902024-12-06T20:52:58.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76912024-12-06T20:52:58.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76922024-12-06T20:52:58.918ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76932024-12-06T20:52:58.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76942024-12-06T20:52:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76952024-12-06T20:52:58.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76962024-12-06T20:52:58.920ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76972024-12-06T20:52:58.920ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76982024-12-06T20:52:58.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76992024-12-06T20:52:58.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77002024-12-06T20:52:58.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
77012024-12-06T20:52:58.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77022024-12-06T20:52:58.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77032024-12-06T20:52:58.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77042024-12-06T20:52:58.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77052024-12-06T20:52:58.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77062024-12-06T20:52:58.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77072024-12-06T20:52:58.931ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 77.676513ms iteration = 18 status = 0
77082024-12-06T20:52:58.932ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77092024-12-06T20:52:58.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77102024-12-06T20:52:58.933ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77112024-12-06T20:52:58.933ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.989403ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77122024-12-06T20:52:58.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
77132024-12-06T20:52:58.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77142024-12-06T20:52:58.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.245538ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77152024-12-06T20:52:58.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77162024-12-06T20:52:58.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.587627ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
77172024-12-06T20:52:58.952ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
77182024-12-06T20:52:58.952ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.474904ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
77192024-12-06T20:52:58.959ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
77202024-12-06T20:52:58.959ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77212024-12-06T20:52:58.960ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6438d80e-4295-4080-a264-e4e16b2ede99", "content-length": "26", "date": "Fri, 06 Dec 2024 20:52:58 GMT"} })
77222024-12-06T20:52:58.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77232024-12-06T20:52:58.962ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77242024-12-06T20:52:58.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 109.422271ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77252024-12-06T20:52:58.963ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
77262024-12-06T20:52:58.963ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77272024-12-06T20:52:58.964ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfe5ba00-fdf1-4020-938b-e933e4dd2d92", "content-length": "26", "date": "Fri, 06 Dec 2024 20:52:58 GMT"} })
77282024-12-06T20:52:58.964ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77292024-12-06T20:52:58.967ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77302024-12-06T20:52:58.973ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77312024-12-06T20:52:58.973ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77322024-12-06T20:52:58.973ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.115437ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77332024-12-06T20:52:58.979ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
77342024-12-06T20:52:58.979ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77352024-12-06T20:52:58.979ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5a2631a-8c4a-4e25-9c6b-e56473c4c0b9", "content-length": "26", "date": "Fri, 06 Dec 2024 20:52:58 GMT"} })
77362024-12-06T20:52:58.979ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77372024-12-06T20:52:58.981ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
77382024-12-06T20:52:58.985ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 131.850969ms iteration = 20 status = {"physical_disks_added":0}
77392024-12-06T20:52:58.990ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77402024-12-06T20:52:58.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77412024-12-06T20:52:58.992ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.911991ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
77422024-12-06T20:52:59.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77432024-12-06T20:52:59.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77442024-12-06T20:52:59.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77452024-12-06T20:52:59.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77462024-12-06T20:52:59.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77472024-12-06T20:52:59.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77482024-12-06T20:52:59.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77492024-12-06T20:52:59.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77502024-12-06T20:52:59.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77512024-12-06T20:52:59.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77522024-12-06T20:52:59.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77532024-12-06T20:52:59.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77542024-12-06T20:52:59.083ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 230.290786ms iteration = 18 status = {}
77552024-12-06T20:52:59.137ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77562024-12-06T20:52:59.137ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77572024-12-06T20:52:59.138ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "561432b3-0e6f-407b-a643-99e4fbb73e91", "content-length": "372", "date": "Fri, 06 Dec 2024 20:52:59 GMT"} })
77582024-12-06T20:52:59.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77592024-12-06T20:52:59.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77602024-12-06T20:52:59.149ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77612024-12-06T20:52:59.149ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecfe07c8-1ca1-4c24-80dc-4ded423890c9", "content-length": "691", "date": "Fri, 06 Dec 2024 20:52:59 GMT"} })
77622024-12-06T20:52:59.149ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
77632024-12-06T20:52:59.149ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
77642024-12-06T20:52:59.149ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
77652024-12-06T20:52:59.150ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77662024-12-06T20:52:59.150ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6f98a3d-a582-455b-aa26-9b1c7e3a414b", "content-length": "1", "date": "Fri, 06 Dec 2024 20:52:58 GMT"} })
77672024-12-06T20:52:59.152ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 298.943927ms iteration = 18 status = {}
77682024-12-06T20:52:59.153ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77692024-12-06T20:52:59.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77702024-12-06T20:52:59.154ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
77712024-12-06T20:52:59.154ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77722024-12-06T20:52:59.155ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "15c3d4c3-99f3-4875-811b-4ed1d66fd98f", "date": "Fri, 06 Dec 2024 20:52:59 GMT"} })
77732024-12-06T20:52:59.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77742024-12-06T20:52:59.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77752024-12-06T20:52:59.155ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 303.474434ms iteration = 18 status = null
77762024-12-06T20:52:59.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77772024-12-06T20:52:59.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77782024-12-06T20:52:59.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77792024-12-06T20:52:59.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77802024-12-06T20:52:59.165ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
77812024-12-06T20:52:59.165ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77822024-12-06T20:52:59.165ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1c325d35-80ac-414a-88f2-4316910c74c9", "date": "Fri, 06 Dec 2024 20:52:59 GMT"} })
77832024-12-06T20:52:59.167ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 314.285983ms iteration = 18 status = {}
77842024-12-06T20:52:59.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77852024-12-06T20:52:59.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77862024-12-06T20:52:59.249ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
77872024-12-06T20:52:59.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77882024-12-06T20:52:59.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77892024-12-06T20:52:59.263ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77902024-12-06T20:52:59.264ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd1a8672-2772-432d-9e24-80fbefcfa02a", "content-length": "134", "date": "Fri, 06 Dec 2024 20:52:58 GMT"} })
77912024-12-06T20:52:59.264ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77922024-12-06T20:52:59.264ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
77932024-12-06T20:52:59.264ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77942024-12-06T20:52:59.264ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77952024-12-06T20:52:59.264ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77962024-12-06T20:52:59.264ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77972024-12-06T20:52:59.264ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77982024-12-06T20:52:59.264ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77992024-12-06T20:52:59.264ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78002024-12-06T20:52:59.264ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78012024-12-06T20:52:59.265ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
78022024-12-06T20:52:59.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78032024-12-06T20:52:59.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78042024-12-06T20:52:59.267ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78052024-12-06T20:52:59.267ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ee3577b-62b3-4528-9310-0151f2d1d8d1", "content-length": "2", "date": "Fri, 06 Dec 2024 20:52:58 GMT"} })
78062024-12-06T20:52:59.267ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78072024-12-06T20:52:59.267ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "11ab2468-2873-4429-aede-90d3730f8ab9", "content-length": "52", "date": "Fri, 06 Dec 2024 20:52:58 GMT"} })
78082024-12-06T20:52:59.267ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
78092024-12-06T20:52:59.267ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78102024-12-06T20:52:59.444ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a559f551-65b3-4613-be48-1cff027e414f", "date": "Fri, 06 Dec 2024 20:52:59 GMT"} })
78112024-12-06T20:52:59.444ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
78122024-12-06T20:52:59.444ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78132024-12-06T20:52:59.445ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "60e49bff-ffa5-4195-a15f-6b0bda2f3fcf", "content-length": "682", "date": "Fri, 06 Dec 2024 20:52:59 GMT"} })
78142024-12-06T20:52:59.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78152024-12-06T20:52:59.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78162024-12-06T20:52:59.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b4dbb9d2-22a3-4e05-8ae1-e642fe7be1c0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78172024-12-06T20:52:59.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b4dbb9d2-22a3-4e05-8ae1-e642fe7be1c0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78182024-12-06T20:52:59.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b4dbb9d2-22a3-4e05-8ae1-e642fe7be1c0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78192024-12-06T20:52:59.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78202024-12-06T20:52:59.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78212024-12-06T20:52:59.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78222024-12-06T20:52:59.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78232024-12-06T20:52:59.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78242024-12-06T20:52:59.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78252024-12-06T20:52:59.462ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 609.057992ms iteration = 18 status = {}
78262024-12-06T20:52:59.504ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
78272024-12-06T20:52:59.504ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
78282024-12-06T20:52:59.534ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
78292024-12-06T20:52:59.534ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:58997
78302024-12-06T20:52:59.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58997 req_id = cb8acb0e-1245-4b10-b592-c7ee8c2da161 roles = RoleSet { roles: {} } uri = /metrics/producers
78312024-12-06T20:52:59.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58997 req_id = cb8acb0e-1245-4b10-b592-c7ee8c2da161 resource = Database result = Ok(()) uri = /metrics/producers
78322024-12-06T20:52:59.571ZINFOnexus: assigned collector to new producer collector_id = bef145b4-2934-45c3-870a-63d45572bde4 file = nexus/src/app/oximeter.rs:76 producer_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
78332024-12-06T20:52:59.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36301 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:58997 req_id = cb8acb0e-1245-4b10-b592-c7ee8c2da161 response_code = 201 uri = /metrics/producers
78342024-12-06T20:52:59.571ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "cb8acb0e-1245-4b10-b592-c7ee8c2da161", "content-length": "41", "date": "Fri, 06 Dec 2024 20:52:59 GMT"} })
78352024-12-06T20:52:59.572ZDEBGnexus (producer-registration-task): registered with nexus successfully
78362024-12-06T20:52:59.572ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
78372024-12-06T20:53:00.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b67c3602-11ed-4b9f-ba46-f678716f5837 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78382024-12-06T20:53:00.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b67c3602-11ed-4b9f-ba46-f678716f5837 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78392024-12-06T20:53:00.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b67c3602-11ed-4b9f-ba46-f678716f5837 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78402024-12-06T20:53:01.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cf266cc7-07c6-45d8-b821-f4f733024171 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78412024-12-06T20:53:01.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cf266cc7-07c6-45d8-b821-f4f733024171 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78422024-12-06T20:53:01.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cf266cc7-07c6-45d8-b821-f4f733024171 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78432024-12-06T20:53:02.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 437 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = e7b91adb-8ed3-4200-98db-68e94021f83c response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
78442024-12-06T20:53:02.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 287f33a7-df59-47b9-b787-37b5d446da4a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78452024-12-06T20:53:02.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 287f33a7-df59-47b9-b787-37b5d446da4a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78462024-12-06T20:53:02.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 287f33a7-df59-47b9-b787-37b5d446da4a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78472024-12-06T20:53:03.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8964cac-a91a-4c10-8ef0-0218a36a5a51 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78482024-12-06T20:53:03.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8964cac-a91a-4c10-8ef0-0218a36a5a51 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78492024-12-06T20:53:03.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8964cac-a91a-4c10-8ef0-0218a36a5a51 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78502024-12-06T20:53:04.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8a1d1bcb-840d-4def-9f54-67e1bd8fa0ec roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78512024-12-06T20:53:04.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8a1d1bcb-840d-4def-9f54-67e1bd8fa0ec resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78522024-12-06T20:53:04.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8a1d1bcb-840d-4def-9f54-67e1bd8fa0ec response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78532024-12-06T20:53:05.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 91719196-9bb3-4767-b186-bf4e84fb77d0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78542024-12-06T20:53:05.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 91719196-9bb3-4767-b186-bf4e84fb77d0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78552024-12-06T20:53:05.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 91719196-9bb3-4767-b186-bf4e84fb77d0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78562024-12-06T20:53:06.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75d637d1-8d29-412f-bb46-9b1ae1dc4cc9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78572024-12-06T20:53:06.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75d637d1-8d29-412f-bb46-9b1ae1dc4cc9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78582024-12-06T20:53:06.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 75d637d1-8d29-412f-bb46-9b1ae1dc4cc9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78592024-12-06T20:53:07.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8985ec88-8796-432f-8a4f-bbd49bda4c96 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78602024-12-06T20:53:07.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8985ec88-8796-432f-8a4f-bbd49bda4c96 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78612024-12-06T20:53:07.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8985ec88-8796-432f-8a4f-bbd49bda4c96 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78622024-12-06T20:53:08.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8ce47788-264e-4fac-9b46-2afac4a1cc3e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78632024-12-06T20:53:08.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8ce47788-264e-4fac-9b46-2afac4a1cc3e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78642024-12-06T20:53:08.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8ce47788-264e-4fac-9b46-2afac4a1cc3e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78652024-12-06T20:53:08.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
78662024-12-06T20:53:08.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
78672024-12-06T20:53:08.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78682024-12-06T20:53:08.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78692024-12-06T20:53:08.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78702024-12-06T20:53:08.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78712024-12-06T20:53:08.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78722024-12-06T20:53:08.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78732024-12-06T20:53:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78742024-12-06T20:53:08.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.519587ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78752024-12-06T20:53:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78762024-12-06T20:53:08.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78772024-12-06T20:53:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78782024-12-06T20:53:08.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78792024-12-06T20:53:08.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78802024-12-06T20:53:08.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78812024-12-06T20:53:08.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
78822024-12-06T20:53:08.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78832024-12-06T20:53:08.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78842024-12-06T20:53:08.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
78852024-12-06T20:53:08.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.004095ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
78862024-12-06T20:53:09.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02f6bc86-d290-4861-9f60-ad2815c2935f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78872024-12-06T20:53:09.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02f6bc86-d290-4861-9f60-ad2815c2935f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78882024-12-06T20:53:09.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1759 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 02f6bc86-d290-4861-9f60-ad2815c2935f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78892024-12-06T20:53:10.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4f6da4ed-e0db-4fb0-971c-bf099f1490cd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78902024-12-06T20:53:10.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4f6da4ed-e0db-4fb0-971c-bf099f1490cd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78912024-12-06T20:53:10.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4f6da4ed-e0db-4fb0-971c-bf099f1490cd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78922024-12-06T20:53:11.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 468560ed-88c6-4174-8d29-680b7673d644 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78932024-12-06T20:53:11.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 468560ed-88c6-4174-8d29-680b7673d644 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78942024-12-06T20:53:11.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 468560ed-88c6-4174-8d29-680b7673d644 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78952024-12-06T20:53:12.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 656 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 9b69a7e3-a338-49ee-81d7-4003ccae0015 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
78962024-12-06T20:53:12.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 431e2a63-1aa4-43ee-8eb9-ae4df9ea7b27 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78972024-12-06T20:53:12.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 431e2a63-1aa4-43ee-8eb9-ae4df9ea7b27 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78982024-12-06T20:53:12.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 431e2a63-1aa4-43ee-8eb9-ae4df9ea7b27 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
78992024-12-06T20:53:13.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e684f651-8c94-409e-834a-e9cc3bf9c91f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79002024-12-06T20:53:13.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e684f651-8c94-409e-834a-e9cc3bf9c91f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79012024-12-06T20:53:13.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e684f651-8c94-409e-834a-e9cc3bf9c91f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79022024-12-06T20:53:14.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8f338398-b238-471d-905f-4c16cf3f7f02 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79032024-12-06T20:53:14.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8f338398-b238-471d-905f-4c16cf3f7f02 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79042024-12-06T20:53:14.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8f338398-b238-471d-905f-4c16cf3f7f02 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79052024-12-06T20:53:15.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9129ddbf-07a5-48a2-af51-e4ac8ab9562d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79062024-12-06T20:53:15.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9129ddbf-07a5-48a2-af51-e4ac8ab9562d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79072024-12-06T20:53:15.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9129ddbf-07a5-48a2-af51-e4ac8ab9562d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79082024-12-06T20:53:16.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 07025589-7e74-4c62-9a93-e0bc7402b979 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79092024-12-06T20:53:16.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 07025589-7e74-4c62-9a93-e0bc7402b979 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79102024-12-06T20:53:16.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 07025589-7e74-4c62-9a93-e0bc7402b979 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79112024-12-06T20:53:17.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e782c320-f323-4e25-aa3f-7fea8b1d0bd5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79122024-12-06T20:53:17.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e782c320-f323-4e25-aa3f-7fea8b1d0bd5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79132024-12-06T20:53:17.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e782c320-f323-4e25-aa3f-7fea8b1d0bd5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79142024-12-06T20:53:18.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
79152024-12-06T20:53:18.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
79162024-12-06T20:53:18.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79172024-12-06T20:53:18.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79182024-12-06T20:53:18.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79192024-12-06T20:53:18.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79202024-12-06T20:53:18.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79212024-12-06T20:53:18.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79222024-12-06T20:53:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79232024-12-06T20:53:18.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.014654ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79242024-12-06T20:53:18.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79252024-12-06T20:53:18.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79262024-12-06T20:53:18.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79272024-12-06T20:53:18.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79282024-12-06T20:53:18.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79292024-12-06T20:53:18.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79302024-12-06T20:53:18.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
79312024-12-06T20:53:18.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79322024-12-06T20:53:18.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79332024-12-06T20:53:18.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
79342024-12-06T20:53:18.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.553668ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
79352024-12-06T20:53:18.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c07ff3c6-c543-4ccf-b1cc-598fd472bd77 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79362024-12-06T20:53:18.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c07ff3c6-c543-4ccf-b1cc-598fd472bd77 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79372024-12-06T20:53:18.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c07ff3c6-c543-4ccf-b1cc-598fd472bd77 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79382024-12-06T20:53:19.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76b9e9c2-ec58-4496-942f-3509428a34b2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79392024-12-06T20:53:19.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76b9e9c2-ec58-4496-942f-3509428a34b2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79402024-12-06T20:53:19.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76b9e9c2-ec58-4496-942f-3509428a34b2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79412024-12-06T20:53:20.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7d5a5bf3-5bf3-493f-905f-759b10867b19 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79422024-12-06T20:53:20.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7d5a5bf3-5bf3-493f-905f-759b10867b19 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79432024-12-06T20:53:20.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7d5a5bf3-5bf3-493f-905f-759b10867b19 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79442024-12-06T20:53:21.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0931c170-f16f-4740-8ebf-694feebef752 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79452024-12-06T20:53:21.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0931c170-f16f-4740-8ebf-694feebef752 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79462024-12-06T20:53:21.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0931c170-f16f-4740-8ebf-694feebef752 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79472024-12-06T20:53:22.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 428 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = b603652d-0bdf-4f56-a6ef-3561208bb7f8 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
79482024-12-06T20:53:22.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c880107-69c3-49f1-956d-400b13a4eaa4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79492024-12-06T20:53:22.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c880107-69c3-49f1-956d-400b13a4eaa4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79502024-12-06T20:53:22.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c880107-69c3-49f1-956d-400b13a4eaa4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79512024-12-06T20:53:24.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6ddbdc4f-4567-4f63-a33e-60e67dd75577 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79522024-12-06T20:53:24.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6ddbdc4f-4567-4f63-a33e-60e67dd75577 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79532024-12-06T20:53:24.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6ddbdc4f-4567-4f63-a33e-60e67dd75577 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79542024-12-06T20:53:25.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9088cad2-a7cc-4011-ada9-1ed3ac9c345e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79552024-12-06T20:53:25.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9088cad2-a7cc-4011-ada9-1ed3ac9c345e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79562024-12-06T20:53:25.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9088cad2-a7cc-4011-ada9-1ed3ac9c345e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79572024-12-06T20:53:26.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5541781d-70e6-48eb-9b24-e5285156e440 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79582024-12-06T20:53:26.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5541781d-70e6-48eb-9b24-e5285156e440 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79592024-12-06T20:53:26.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5541781d-70e6-48eb-9b24-e5285156e440 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79602024-12-06T20:53:27.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 702e947a-12b4-4d09-8485-1e3c1a120afc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79612024-12-06T20:53:27.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 702e947a-12b4-4d09-8485-1e3c1a120afc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79622024-12-06T20:53:27.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 702e947a-12b4-4d09-8485-1e3c1a120afc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79632024-12-06T20:53:28.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 238f4874-c5f8-41f4-a908-4a6beda70166 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79642024-12-06T20:53:28.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 238f4874-c5f8-41f4-a908-4a6beda70166 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79652024-12-06T20:53:28.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 238f4874-c5f8-41f4-a908-4a6beda70166 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
79662024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
79672024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79682024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
79692024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
79702024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79712024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
79722024-12-06T20:53:28.852ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:43:28.852092379 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
79732024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
79742024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
79752024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
79762024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79772024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
79782024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
79792024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
79802024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
79812024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79822024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
79832024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79842024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
79852024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79862024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79872024-12-06T20:53:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79882024-12-06T20:53:28.852ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6739, tv_nsec: 192757722 } })
79892024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
79902024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
79912024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79922024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79932024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
79942024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
79952024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
79962024-12-06T20:53:28.853ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
79972024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
79982024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.7\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
79992024-12-06T20:53:28.853ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
80002024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80012024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
80022024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80032024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
80042024-12-06T20:53:28.853ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6739, tv_nsec: 193043470 } })
80052024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80062024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
80072024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
80082024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
80092024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80102024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
80112024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
80122024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80132024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80142024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
80152024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80162024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
80172024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80182024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
80192024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
80202024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
80212024-12-06T20:53:28.853ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80222024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80232024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
80242024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80252024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
80262024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
80272024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
80282024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80292024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
80302024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80312024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80322024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80332024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
80342024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
80352024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80362024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80372024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
80382024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80392024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80402024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80412024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
80422024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.622552ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
80432024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80442024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
80452024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80462024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80472024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
80482024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
80492024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.771336ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
80502024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80512024-12-06T20:53:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80522024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80532024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80542024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
80552024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80562024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
80572024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80582024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80592024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80602024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80612024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80622024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80632024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80642024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80652024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80662024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80672024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80682024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
80692024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80702024-12-06T20:53:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80712024-12-06T20:53:28.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6739, tv_nsec: 195166435 } })
80722024-12-06T20:53:28.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80732024-12-06T20:53:28.855ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
80742024-12-06T20:53:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80752024-12-06T20:53:28.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80762024-12-06T20:53:28.856ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:43:28.852092379 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
80772024-12-06T20:53:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.162688ms iteration = 10 status = {"expiration":"2024-12-06T20:43:28.852092379Z","pruned":[]}
80782024-12-06T20:53:28.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80792024-12-06T20:53:28.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80802024-12-06T20:53:28.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80812024-12-06T20:53:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80822024-12-06T20:53:28.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80832024-12-06T20:53:28.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80842024-12-06T20:53:28.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80852024-12-06T20:53:28.859ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.519172ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80862024-12-06T20:53:28.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80872024-12-06T20:53:28.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80882024-12-06T20:53:28.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80892024-12-06T20:53:28.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80902024-12-06T20:53:28.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80912024-12-06T20:53:28.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80922024-12-06T20:53:28.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80932024-12-06T20:53:28.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80942024-12-06T20:53:28.863ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80952024-12-06T20:53:28.863ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6739, tv_nsec: 203113540 } })
80962024-12-06T20:53:28.863ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
80972024-12-06T20:53:28.864ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80982024-12-06T20:53:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80992024-12-06T20:53:28.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81002024-12-06T20:53:28.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
81012024-12-06T20:53:28.865ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
81022024-12-06T20:53:28.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
81032024-12-06T20:53:28.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81042024-12-06T20:53:28.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81052024-12-06T20:53:28.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81062024-12-06T20:53:28.868ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.074008ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
81072024-12-06T20:53:28.870ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81082024-12-06T20:53:28.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81092024-12-06T20:53:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81102024-12-06T20:53:28.873ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81112024-12-06T20:53:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
81122024-12-06T20:53:28.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81132024-12-06T20:53:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81142024-12-06T20:53:28.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81152024-12-06T20:53:28.879ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81162024-12-06T20:53:28.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81172024-12-06T20:53:28.882ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81182024-12-06T20:53:28.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81192024-12-06T20:53:28.882ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81202024-12-06T20:53:28.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81212024-12-06T20:53:28.885ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81222024-12-06T20:53:28.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81232024-12-06T20:53:28.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81242024-12-06T20:53:28.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81252024-12-06T20:53:28.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81262024-12-06T20:53:28.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81272024-12-06T20:53:28.896ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6739, tv_nsec: 235590647 } })
81282024-12-06T20:53:28.896ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
81292024-12-06T20:53:28.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81302024-12-06T20:53:28.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81312024-12-06T20:53:28.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81322024-12-06T20:53:28.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81332024-12-06T20:53:28.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81342024-12-06T20:53:28.926ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81352024-12-06T20:53:28.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81362024-12-06T20:53:28.928ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81372024-12-06T20:53:28.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81382024-12-06T20:53:28.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81392024-12-06T20:53:28.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.218605ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
81402024-12-06T20:53:28.932ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81412024-12-06T20:53:28.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81422024-12-06T20:53:28.937ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81432024-12-06T20:53:28.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81442024-12-06T20:53:28.942ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
81452024-12-06T20:53:28.942ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
81462024-12-06T20:53:28.942ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 89.343803ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
81472024-12-06T20:53:28.946ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81482024-12-06T20:53:28.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81492024-12-06T20:53:28.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 96.57855ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
81502024-12-06T20:53:28.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81512024-12-06T20:53:28.951ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81522024-12-06T20:53:28.953ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81532024-12-06T20:53:28.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81542024-12-06T20:53:28.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81552024-12-06T20:53:28.954ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
81562024-12-06T20:53:28.954ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
81572024-12-06T20:53:28.954ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 101.529608ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
81582024-12-06T20:53:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81592024-12-06T20:53:28.955ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81602024-12-06T20:53:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81612024-12-06T20:53:28.955ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81622024-12-06T20:53:28.956ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
81632024-12-06T20:53:28.956ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
81642024-12-06T20:53:28.956ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
81652024-12-06T20:53:28.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81662024-12-06T20:53:28.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81672024-12-06T20:53:28.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 103.55221ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81682024-12-06T20:53:28.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81692024-12-06T20:53:28.958ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81702024-12-06T20:53:28.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81712024-12-06T20:53:28.966ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81722024-12-06T20:53:28.966ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81732024-12-06T20:53:28.966ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81742024-12-06T20:53:28.966ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81752024-12-06T20:53:28.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.580578ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81762024-12-06T20:53:28.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81772024-12-06T20:53:28.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81782024-12-06T20:53:28.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81792024-12-06T20:53:28.986ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
81802024-12-06T20:53:28.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
81812024-12-06T20:53:29.002ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
81822024-12-06T20:53:29.002ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81832024-12-06T20:53:29.003ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "74ae5c90-fd31-444e-a158-d9037047a274", "content-length": "26", "date": "Fri, 06 Dec 2024 20:53:28 GMT"} })
81842024-12-06T20:53:29.003ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81852024-12-06T20:53:29.005ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81862024-12-06T20:53:29.011ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
81872024-12-06T20:53:29.017ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
81882024-12-06T20:53:29.018ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
81892024-12-06T20:53:29.018ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
81902024-12-06T20:53:29.018ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
81912024-12-06T20:53:29.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81922024-12-06T20:53:29.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81932024-12-06T20:53:29.048ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
81942024-12-06T20:53:29.048ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81952024-12-06T20:53:29.048ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4b15f4e-fed1-4510-bc98-cc61431e7739", "content-length": "26", "date": "Fri, 06 Dec 2024 20:53:28 GMT"} })
81962024-12-06T20:53:29.048ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81972024-12-06T20:53:29.051ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
81982024-12-06T20:53:29.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81992024-12-06T20:53:29.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82002024-12-06T20:53:29.097ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
82012024-12-06T20:53:29.097ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82022024-12-06T20:53:29.098ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7e8c68a-60f6-430e-896b-eeb0b6795937", "content-length": "26", "date": "Fri, 06 Dec 2024 20:53:28 GMT"} })
82032024-12-06T20:53:29.098ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82042024-12-06T20:53:29.099ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82052024-12-06T20:53:29.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7d186e76-0c53-4949-b3fc-cce0230b10be roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
82062024-12-06T20:53:29.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7d186e76-0c53-4949-b3fc-cce0230b10be resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
82072024-12-06T20:53:29.171ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
82082024-12-06T20:53:29.171ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "935407ab-7a76-480f-92ab-b8c7ee31990a", "date": "Fri, 06 Dec 2024 20:53:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
82092024-12-06T20:53:29.171ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
82102024-12-06T20:53:29.172ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c2359ac8-d42f-4b71-8e19-072142f552ce", "date": "Fri, 06 Dec 2024 20:53:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
82112024-12-06T20:53:29.172ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
82122024-12-06T20:53:29.174ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
82132024-12-06T20:53:29.174ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 322.155965ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
82142024-12-06T20:53:29.188ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
82152024-12-06T20:53:29.242ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 389.184464ms iteration = 19 status = {}
82162024-12-06T20:53:29.252ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
82172024-12-06T20:53:29.252ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82182024-12-06T20:53:29.252ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebba0c87-abfb-4e6b-9752-ddc85848eb57", "content-length": "372", "date": "Fri, 06 Dec 2024 20:53:29 GMT"} })
82192024-12-06T20:53:29.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82202024-12-06T20:53:29.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82212024-12-06T20:53:29.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82222024-12-06T20:53:29.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82232024-12-06T20:53:29.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82242024-12-06T20:53:29.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
82252024-12-06T20:53:29.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82262024-12-06T20:53:29.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82272024-12-06T20:53:29.262ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 408.621994ms iteration = 5 status = {"nsuccess":5}
82282024-12-06T20:53:29.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82292024-12-06T20:53:29.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7d186e76-0c53-4949-b3fc-cce0230b10be response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
82302024-12-06T20:53:29.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82312024-12-06T20:53:29.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82322024-12-06T20:53:29.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82332024-12-06T20:53:29.280ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
82342024-12-06T20:53:29.280ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 427.000768ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
82352024-12-06T20:53:29.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82362024-12-06T20:53:29.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82372024-12-06T20:53:29.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82382024-12-06T20:53:29.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82392024-12-06T20:53:29.287ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
82402024-12-06T20:53:29.287ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f8d1353-210a-419f-ab4d-a003785aee85", "content-length": "1", "date": "Fri, 06 Dec 2024 20:53:28 GMT"} })
82412024-12-06T20:53:29.289ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82422024-12-06T20:53:29.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82432024-12-06T20:53:29.294ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 442.59643ms iteration = 19 status = null
82442024-12-06T20:53:29.298ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
82452024-12-06T20:53:29.298ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7269c73f-af28-4dce-a89e-e4b316780e48", "date": "Fri, 06 Dec 2024 20:53:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82462024-12-06T20:53:29.298ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82472024-12-06T20:53:29.301ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b1844e23-978c-4820-9a77-f17ebd6c9d96", "date": "Fri, 06 Dec 2024 20:53:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82482024-12-06T20:53:29.301ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82492024-12-06T20:53:29.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82502024-12-06T20:53:29.302ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8f0a8157-0d48-4f9f-ac55-ef23703c6931", "date": "Fri, 06 Dec 2024 20:53:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82512024-12-06T20:53:29.302ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82522024-12-06T20:53:29.304ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
82532024-12-06T20:53:29.304ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 452.352401ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
82542024-12-06T20:53:29.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
82552024-12-06T20:53:29.305ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82562024-12-06T20:53:29.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82572024-12-06T20:53:29.305ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82582024-12-06T20:53:29.305ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82592024-12-06T20:53:29.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82602024-12-06T20:53:29.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 452.746662ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82612024-12-06T20:53:29.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82622024-12-06T20:53:29.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 452.953798ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
82632024-12-06T20:53:29.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 453.280376ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
82642024-12-06T20:53:29.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82652024-12-06T20:53:29.309ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
82662024-12-06T20:53:29.309ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
82672024-12-06T20:53:29.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82682024-12-06T20:53:29.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82692024-12-06T20:53:29.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82702024-12-06T20:53:29.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82712024-12-06T20:53:29.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82722024-12-06T20:53:29.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82732024-12-06T20:53:29.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82742024-12-06T20:53:29.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82752024-12-06T20:53:29.312ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82762024-12-06T20:53:29.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82772024-12-06T20:53:29.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82782024-12-06T20:53:29.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82792024-12-06T20:53:29.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82802024-12-06T20:53:29.324ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
82812024-12-06T20:53:29.325ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
82822024-12-06T20:53:29.325ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
82832024-12-06T20:53:29.325ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 472.921372ms iteration = 10 status = {"generation":1}
82842024-12-06T20:53:29.328ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
82852024-12-06T20:53:29.328ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
82862024-12-06T20:53:29.328ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bac601e7-3fad-41a4-878c-38a9fe8903a4", "date": "Fri, 06 Dec 2024 20:53:29 GMT"} })
82872024-12-06T20:53:29.328ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82882024-12-06T20:53:29.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82892024-12-06T20:53:29.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82902024-12-06T20:53:29.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82912024-12-06T20:53:29.336ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82922024-12-06T20:53:29.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82932024-12-06T20:53:29.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82942024-12-06T20:53:29.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
82952024-12-06T20:53:29.338ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82962024-12-06T20:53:29.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82972024-12-06T20:53:29.341ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 488.724019ms iteration = 19 status = 0
82982024-12-06T20:53:29.342ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
82992024-12-06T20:53:29.342ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83002024-12-06T20:53:29.343ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3d6d3fb5-bc7e-4a5f-adf2-80661f4820a3", "date": "Fri, 06 Dec 2024 20:53:29 GMT"} })
83012024-12-06T20:53:29.343ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83022024-12-06T20:53:29.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83032024-12-06T20:53:29.345ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83042024-12-06T20:53:29.345ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 491.957872ms iteration = 19 status = {}
83052024-12-06T20:53:29.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83062024-12-06T20:53:29.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83072024-12-06T20:53:29.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
83082024-12-06T20:53:29.347ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83092024-12-06T20:53:29.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83102024-12-06T20:53:29.349ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
83112024-12-06T20:53:29.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83122024-12-06T20:53:29.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83132024-12-06T20:53:29.350ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83142024-12-06T20:53:29.350ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
83152024-12-06T20:53:29.350ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 496.981253ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
83162024-12-06T20:53:29.360ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
83172024-12-06T20:53:29.361ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f61932f-ff11-4876-bbb5-b510cb5a55a8", "content-length": "134", "date": "Fri, 06 Dec 2024 20:53:28 GMT"} })
83182024-12-06T20:53:29.361ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
83192024-12-06T20:53:29.361ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
83202024-12-06T20:53:29.361ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
83212024-12-06T20:53:29.361ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
83222024-12-06T20:53:29.361ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83232024-12-06T20:53:29.361ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83242024-12-06T20:53:29.361ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83252024-12-06T20:53:29.361ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83262024-12-06T20:53:29.361ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83272024-12-06T20:53:29.361ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83282024-12-06T20:53:29.362ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
83292024-12-06T20:53:29.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83302024-12-06T20:53:29.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83312024-12-06T20:53:29.363ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
83322024-12-06T20:53:29.363ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
83332024-12-06T20:53:29.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83342024-12-06T20:53:29.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83352024-12-06T20:53:29.364ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83362024-12-06T20:53:29.364ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a0b0470-2ce6-4afb-8f66-f26f2255ae5b", "content-length": "2", "date": "Fri, 06 Dec 2024 20:53:28 GMT"} })
83372024-12-06T20:53:29.364ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83382024-12-06T20:53:29.364ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ee2c750-fdf6-4ec3-90f8-bae873b708b2", "content-length": "52", "date": "Fri, 06 Dec 2024 20:53:28 GMT"} })
83392024-12-06T20:53:29.364ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
83402024-12-06T20:53:29.364ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83412024-12-06T20:53:29.369ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
83422024-12-06T20:53:29.369ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 516.633569ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
83432024-12-06T20:53:29.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83442024-12-06T20:53:29.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83452024-12-06T20:53:29.378ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) }
83462024-12-06T20:53:29.378ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 526.649137ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
83472024-12-06T20:53:29.398ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83482024-12-06T20:53:29.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83492024-12-06T20:53:29.400ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83502024-12-06T20:53:29.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83512024-12-06T20:53:29.403ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
83522024-12-06T20:53:29.403ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
83532024-12-06T20:53:29.403ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
83542024-12-06T20:53:29.403ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 550.980914ms iteration = 10 status = {"generation":2}
83552024-12-06T20:53:29.406ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83562024-12-06T20:53:29.408ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83572024-12-06T20:53:29.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83582024-12-06T20:53:29.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83592024-12-06T20:53:29.416ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 563.58919ms iteration = 21 status = {"physical_disks_added":0}
83602024-12-06T20:53:29.442ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83612024-12-06T20:53:29.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83622024-12-06T20:53:29.443ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83632024-12-06T20:53:29.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83642024-12-06T20:53:29.471ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1027e0c3-c2ef-43ce-aa05-a4f44d3f8935", "date": "Fri, 06 Dec 2024 20:53:29 GMT"} })
83652024-12-06T20:53:29.471ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
83662024-12-06T20:53:29.471ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83672024-12-06T20:53:29.472ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "14cc49bd-b8d7-41eb-a34c-c0a377785baf", "content-length": "682", "date": "Fri, 06 Dec 2024 20:53:29 GMT"} })
83682024-12-06T20:53:29.472ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83692024-12-06T20:53:29.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83702024-12-06T20:53:29.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83712024-12-06T20:53:29.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83722024-12-06T20:53:29.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83732024-12-06T20:53:29.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83742024-12-06T20:53:29.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83752024-12-06T20:53:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83762024-12-06T20:53:29.490ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 637.665289ms iteration = 19 status = {}
83772024-12-06T20:53:29.536ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
83782024-12-06T20:53:29.537ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6e06138-62f3-46c8-9e12-f32306abeb7e", "content-length": "691", "date": "Fri, 06 Dec 2024 20:53:29 GMT"} })
83792024-12-06T20:53:29.537ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
83802024-12-06T20:53:29.537ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
83812024-12-06T20:53:29.537ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
83822024-12-06T20:53:29.537ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 684.444055ms iteration = 19 status = {}
83832024-12-06T20:53:30.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d5a224e-4dbb-4904-94bf-e09051603d83 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83842024-12-06T20:53:30.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d5a224e-4dbb-4904-94bf-e09051603d83 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83852024-12-06T20:53:30.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d5a224e-4dbb-4904-94bf-e09051603d83 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83862024-12-06T20:53:31.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 04064879-0347-424b-8755-84799fc4c040 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83872024-12-06T20:53:31.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 04064879-0347-424b-8755-84799fc4c040 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83882024-12-06T20:53:31.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 04064879-0347-424b-8755-84799fc4c040 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83892024-12-06T20:53:32.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d6c9efb2-5359-45ed-bf71-e961d6366280 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83902024-12-06T20:53:32.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d6c9efb2-5359-45ed-bf71-e961d6366280 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83912024-12-06T20:53:32.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d6c9efb2-5359-45ed-bf71-e961d6366280 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83922024-12-06T20:53:32.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 521 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 7ff9c49f-ff16-4758-8b9d-8b59ef73ad99 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
83932024-12-06T20:53:33.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d5655d2-67f6-462a-950f-107fd757402c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83942024-12-06T20:53:33.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d5655d2-67f6-462a-950f-107fd757402c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83952024-12-06T20:53:33.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d5655d2-67f6-462a-950f-107fd757402c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83962024-12-06T20:53:34.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ae6635dd-55a5-4b04-8cc8-62666a75bfe4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83972024-12-06T20:53:34.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ae6635dd-55a5-4b04-8cc8-62666a75bfe4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83982024-12-06T20:53:34.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ae6635dd-55a5-4b04-8cc8-62666a75bfe4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
83992024-12-06T20:53:35.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5dc0d929-5a24-43c1-bd95-336bba21b794 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84002024-12-06T20:53:35.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5dc0d929-5a24-43c1-bd95-336bba21b794 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84012024-12-06T20:53:35.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5dc0d929-5a24-43c1-bd95-336bba21b794 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84022024-12-06T20:53:36.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c29119d8-891b-4d66-abc3-18bfb1513ec0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84032024-12-06T20:53:36.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c29119d8-891b-4d66-abc3-18bfb1513ec0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84042024-12-06T20:53:36.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c29119d8-891b-4d66-abc3-18bfb1513ec0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84052024-12-06T20:53:37.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 211e320b-22a8-44e4-8f59-0b1c988c8834 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84062024-12-06T20:53:37.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 211e320b-22a8-44e4-8f59-0b1c988c8834 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84072024-12-06T20:53:37.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 211e320b-22a8-44e4-8f59-0b1c988c8834 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84082024-12-06T20:53:38.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 472d068b-ed41-4180-8bee-caabf62fc83c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84092024-12-06T20:53:38.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 472d068b-ed41-4180-8bee-caabf62fc83c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84102024-12-06T20:53:38.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 472d068b-ed41-4180-8bee-caabf62fc83c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84112024-12-06T20:53:38.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
84122024-12-06T20:53:38.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
84132024-12-06T20:53:38.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84142024-12-06T20:53:38.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84152024-12-06T20:53:38.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84162024-12-06T20:53:38.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84172024-12-06T20:53:38.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84182024-12-06T20:53:38.857ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84192024-12-06T20:53:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84202024-12-06T20:53:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84212024-12-06T20:53:38.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84222024-12-06T20:53:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84232024-12-06T20:53:38.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84242024-12-06T20:53:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84252024-12-06T20:53:38.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84262024-12-06T20:53:38.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
84272024-12-06T20:53:38.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84282024-12-06T20:53:38.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84292024-12-06T20:53:38.877ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
84302024-12-06T20:53:38.877ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.659045ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
84312024-12-06T20:53:38.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.037038ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84322024-12-06T20:53:39.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d14cca54-2f4a-49ce-9293-ae21c53b7f13 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84332024-12-06T20:53:39.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d14cca54-2f4a-49ce-9293-ae21c53b7f13 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84342024-12-06T20:53:39.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d14cca54-2f4a-49ce-9293-ae21c53b7f13 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84352024-12-06T20:53:40.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e86169bf-ac4c-4cae-a0e2-a5c5fbaa5793 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84362024-12-06T20:53:40.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e86169bf-ac4c-4cae-a0e2-a5c5fbaa5793 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84372024-12-06T20:53:40.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e86169bf-ac4c-4cae-a0e2-a5c5fbaa5793 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84382024-12-06T20:53:41.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 30b8e8bb-4883-4b17-8cf1-4785d9694305 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84392024-12-06T20:53:41.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 30b8e8bb-4883-4b17-8cf1-4785d9694305 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84402024-12-06T20:53:41.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 30b8e8bb-4883-4b17-8cf1-4785d9694305 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84412024-12-06T20:53:42.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 05acbd87-737e-4e91-82c5-ad97c0f3bf1a response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
84422024-12-06T20:53:42.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6651a0cc-8540-4755-867b-84d307c966ce roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84432024-12-06T20:53:42.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6651a0cc-8540-4755-867b-84d307c966ce resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84442024-12-06T20:53:42.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6651a0cc-8540-4755-867b-84d307c966ce response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84452024-12-06T20:53:43.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 043b6574-84ba-4d72-8190-48887f765bf6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84462024-12-06T20:53:43.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 043b6574-84ba-4d72-8190-48887f765bf6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84472024-12-06T20:53:43.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 043b6574-84ba-4d72-8190-48887f765bf6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84482024-12-06T20:53:44.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4f1250e0-9103-4544-80fc-4e45cb50f4d0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84492024-12-06T20:53:44.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4f1250e0-9103-4544-80fc-4e45cb50f4d0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84502024-12-06T20:53:44.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4f1250e0-9103-4544-80fc-4e45cb50f4d0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84512024-12-06T20:53:45.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70c089ee-b9b1-41e7-b414-06937d297755 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84522024-12-06T20:53:45.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70c089ee-b9b1-41e7-b414-06937d297755 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84532024-12-06T20:53:45.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 70c089ee-b9b1-41e7-b414-06937d297755 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84542024-12-06T20:53:46.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dea17579-32da-4abf-bd7e-bd1ced711c44 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84552024-12-06T20:53:46.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dea17579-32da-4abf-bd7e-bd1ced711c44 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84562024-12-06T20:53:46.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dea17579-32da-4abf-bd7e-bd1ced711c44 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84572024-12-06T20:53:47.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f9232104-5289-4851-b1c4-c69e2702a64c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84582024-12-06T20:53:47.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f9232104-5289-4851-b1c4-c69e2702a64c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84592024-12-06T20:53:47.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f9232104-5289-4851-b1c4-c69e2702a64c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84602024-12-06T20:53:48.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7e75b173-3cf4-4cb4-b34f-c90ed0c40cea roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84612024-12-06T20:53:48.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7e75b173-3cf4-4cb4-b34f-c90ed0c40cea resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84622024-12-06T20:53:48.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7e75b173-3cf4-4cb4-b34f-c90ed0c40cea response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84632024-12-06T20:53:48.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
84642024-12-06T20:53:48.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
84652024-12-06T20:53:48.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84662024-12-06T20:53:48.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84672024-12-06T20:53:48.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84682024-12-06T20:53:48.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84692024-12-06T20:53:48.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84702024-12-06T20:53:48.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84712024-12-06T20:53:48.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.88462ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84722024-12-06T20:53:48.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84732024-12-06T20:53:48.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84742024-12-06T20:53:48.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84752024-12-06T20:53:48.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84762024-12-06T20:53:48.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84772024-12-06T20:53:48.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84782024-12-06T20:53:48.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84792024-12-06T20:53:48.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
84802024-12-06T20:53:48.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84812024-12-06T20:53:48.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84822024-12-06T20:53:48.911ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
84832024-12-06T20:53:48.911ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.512943ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
84842024-12-06T20:53:49.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 605ebeac-d200-4ef5-91ed-02641b96b903 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84852024-12-06T20:53:49.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 605ebeac-d200-4ef5-91ed-02641b96b903 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84862024-12-06T20:53:49.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 605ebeac-d200-4ef5-91ed-02641b96b903 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84872024-12-06T20:53:50.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 602c778d-7300-4897-b178-f6ac12952d27 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84882024-12-06T20:53:50.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 602c778d-7300-4897-b178-f6ac12952d27 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84892024-12-06T20:53:50.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 602c778d-7300-4897-b178-f6ac12952d27 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84902024-12-06T20:53:51.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e9f97ab3-79e7-4541-be83-20240d86b790 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84912024-12-06T20:53:51.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e9f97ab3-79e7-4541-be83-20240d86b790 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84922024-12-06T20:53:51.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e9f97ab3-79e7-4541-be83-20240d86b790 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84932024-12-06T20:53:52.414ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 14f74a76-2977-4267-badc-fc36131dc0cc response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
84942024-12-06T20:53:52.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a38dafd3-38ba-456b-9af3-7229ef03e557 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84952024-12-06T20:53:52.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a38dafd3-38ba-456b-9af3-7229ef03e557 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84962024-12-06T20:53:52.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a38dafd3-38ba-456b-9af3-7229ef03e557 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84972024-12-06T20:53:53.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eca3c35b-2bec-4aaa-b905-8fca2dac9d92 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84982024-12-06T20:53:53.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eca3c35b-2bec-4aaa-b905-8fca2dac9d92 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
84992024-12-06T20:53:53.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eca3c35b-2bec-4aaa-b905-8fca2dac9d92 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85002024-12-06T20:53:54.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ccd8595d-529c-4a68-a3ff-25fd2721b1c5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85012024-12-06T20:53:54.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ccd8595d-529c-4a68-a3ff-25fd2721b1c5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85022024-12-06T20:53:54.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ccd8595d-529c-4a68-a3ff-25fd2721b1c5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85032024-12-06T20:53:55.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc292d7d-e0b3-4abb-a363-e51b82b73dee roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85042024-12-06T20:53:55.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc292d7d-e0b3-4abb-a363-e51b82b73dee resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85052024-12-06T20:53:55.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc292d7d-e0b3-4abb-a363-e51b82b73dee response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85062024-12-06T20:53:56.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 562d5acc-ad78-4782-a780-411527346df1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85072024-12-06T20:53:56.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 562d5acc-ad78-4782-a780-411527346df1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85082024-12-06T20:53:56.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 562d5acc-ad78-4782-a780-411527346df1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85092024-12-06T20:53:57.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 23bdf2db-fe3a-45c1-bdf1-42ca9f0b6768 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85102024-12-06T20:53:57.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 23bdf2db-fe3a-45c1-bdf1-42ca9f0b6768 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85112024-12-06T20:53:57.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 23bdf2db-fe3a-45c1-bdf1-42ca9f0b6768 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
85122024-12-06T20:53:58.852ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
85132024-12-06T20:53:58.852ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85142024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85152024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
85162024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85172024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
85182024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85192024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
85202024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
85212024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85222024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85232024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
85242024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
85252024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85262024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85272024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
85282024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
85292024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85302024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85312024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85322024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
85332024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
85342024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
85352024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
85362024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85372024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
85382024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
85392024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
85402024-12-06T20:53:58.853ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
85412024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
85422024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85432024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85442024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
85452024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85462024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
85472024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85482024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85492024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85502024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85512024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85522024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85532024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85542024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85552024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85562024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85572024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85582024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85592024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85602024-12-06T20:53:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85612024-12-06T20:53:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85622024-12-06T20:53:58.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85632024-12-06T20:53:58.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6769, tv_nsec: 195746498 } })
85642024-12-06T20:53:58.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85652024-12-06T20:53:58.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
85662024-12-06T20:53:58.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85672024-12-06T20:53:58.856ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.564702ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85682024-12-06T20:53:58.858ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85692024-12-06T20:53:58.858ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85702024-12-06T20:53:58.858ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85712024-12-06T20:53:58.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85722024-12-06T20:53:58.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85732024-12-06T20:53:58.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85742024-12-06T20:53:58.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85752024-12-06T20:53:58.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85762024-12-06T20:53:58.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85772024-12-06T20:53:58.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85782024-12-06T20:53:58.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85792024-12-06T20:53:58.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85802024-12-06T20:53:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85812024-12-06T20:53:58.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85822024-12-06T20:53:58.865ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6769, tv_nsec: 205511810 } })
85832024-12-06T20:53:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85842024-12-06T20:53:58.865ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
85852024-12-06T20:53:58.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85862024-12-06T20:53:58.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85872024-12-06T20:53:58.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85882024-12-06T20:53:58.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85892024-12-06T20:53:58.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85902024-12-06T20:53:58.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85912024-12-06T20:53:58.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85922024-12-06T20:53:58.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85932024-12-06T20:53:58.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85942024-12-06T20:53:58.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85952024-12-06T20:53:58.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85962024-12-06T20:53:58.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85972024-12-06T20:53:58.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85982024-12-06T20:53:58.876ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6769, tv_nsec: 216084903 } })
85992024-12-06T20:53:58.876ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
86002024-12-06T20:53:58.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86012024-12-06T20:53:58.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86022024-12-06T20:53:58.889ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86032024-12-06T20:53:58.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86042024-12-06T20:53:58.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2dd64e86-5bbc-4098-a8ba-9fc2cf4e77e7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
86052024-12-06T20:53:58.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2dd64e86-5bbc-4098-a8ba-9fc2cf4e77e7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
86062024-12-06T20:53:58.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2dd64e86-5bbc-4098-a8ba-9fc2cf4e77e7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
86072024-12-06T20:53:58.909ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86082024-12-06T20:53:58.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86092024-12-06T20:53:58.923ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86102024-12-06T20:53:58.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.751879ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
86112024-12-06T20:53:58.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.94838ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
86122024-12-06T20:53:58.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
86132024-12-06T20:53:58.926ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86142024-12-06T20:53:58.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86152024-12-06T20:53:58.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86162024-12-06T20:53:58.929ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86172024-12-06T20:53:58.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86182024-12-06T20:53:58.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
86192024-12-06T20:53:58.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86202024-12-06T20:53:58.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86212024-12-06T20:53:58.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.208012ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86222024-12-06T20:53:58.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86232024-12-06T20:53:58.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86242024-12-06T20:53:58.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86252024-12-06T20:53:58.935ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86262024-12-06T20:53:58.936ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86272024-12-06T20:53:58.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86282024-12-06T20:53:58.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86292024-12-06T20:53:58.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86302024-12-06T20:53:58.937ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86312024-12-06T20:53:58.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86322024-12-06T20:53:58.938ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.598441ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86332024-12-06T20:53:58.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86342024-12-06T20:53:58.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86352024-12-06T20:53:58.941ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86362024-12-06T20:53:58.941ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86372024-12-06T20:53:58.941ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d89f6c4-ad80-4a07-972f-e34da16b5320", "content-length": "26", "date": "Fri, 06 Dec 2024 20:53:58 GMT"} })
86382024-12-06T20:53:58.941ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86392024-12-06T20:53:58.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
86402024-12-06T20:53:58.943ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86412024-12-06T20:53:58.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86422024-12-06T20:53:58.943ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86432024-12-06T20:53:58.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86442024-12-06T20:53:58.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86452024-12-06T20:53:58.943ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86462024-12-06T20:53:58.945ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.588247ms iteration = 20 status = 0
86472024-12-06T20:53:58.946ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
86482024-12-06T20:53:58.946ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.995407ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
86492024-12-06T20:53:58.948ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86502024-12-06T20:53:58.948ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86512024-12-06T20:53:58.948ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86522024-12-06T20:53:58.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86532024-12-06T20:53:58.953ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86542024-12-06T20:53:58.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86552024-12-06T20:53:58.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86562024-12-06T20:53:58.957ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86572024-12-06T20:53:58.957ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c81bb10e-3b37-4104-81fa-3ff372b73246", "content-length": "26", "date": "Fri, 06 Dec 2024 20:53:58 GMT"} })
86582024-12-06T20:53:58.957ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86592024-12-06T20:53:58.959ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86602024-12-06T20:53:58.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
86612024-12-06T20:53:58.960ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86622024-12-06T20:53:58.960ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f946c534-72d9-4542-a015-1b9162accc7d", "content-length": "26", "date": "Fri, 06 Dec 2024 20:53:58 GMT"} })
86632024-12-06T20:53:58.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86642024-12-06T20:53:58.963ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
86652024-12-06T20:53:58.971ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86662024-12-06T20:53:58.971ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 117.684864ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86672024-12-06T20:53:58.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.521278ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
86682024-12-06T20:53:58.999ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86692024-12-06T20:53:58.999ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86702024-12-06T20:53:58.999ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.943642ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86712024-12-06T20:53:58.999ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.213579ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
86722024-12-06T20:53:59.012ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.838085ms iteration = 22 status = {"physical_disks_added":0}
86732024-12-06T20:53:59.019ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86742024-12-06T20:53:59.020ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0655262-6072-4b46-b21e-9f3cf14b95ed", "content-length": "1", "date": "Fri, 06 Dec 2024 20:53:58 GMT"} })
86752024-12-06T20:53:59.021ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86762024-12-06T20:53:59.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86772024-12-06T20:53:59.024ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 171.570753ms iteration = 20 status = null
86782024-12-06T20:53:59.027ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 173.841782ms iteration = 20 status = {}
86792024-12-06T20:53:59.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86802024-12-06T20:53:59.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86812024-12-06T20:53:59.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86822024-12-06T20:53:59.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86832024-12-06T20:53:59.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86842024-12-06T20:53:59.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86852024-12-06T20:53:59.084ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86862024-12-06T20:53:59.084ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86872024-12-06T20:53:59.084ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bbe872e-c38f-40c3-a9b0-d1361bb525b3", "content-length": "372", "date": "Fri, 06 Dec 2024 20:53:59 GMT"} })
86882024-12-06T20:53:59.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86892024-12-06T20:53:59.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86902024-12-06T20:53:59.114ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86912024-12-06T20:53:59.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86922024-12-06T20:53:59.116ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86932024-12-06T20:53:59.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86942024-12-06T20:53:59.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86952024-12-06T20:53:59.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86962024-12-06T20:53:59.126ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
86972024-12-06T20:53:59.126ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86982024-12-06T20:53:59.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86992024-12-06T20:53:59.128ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
87002024-12-06T20:53:59.128ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87012024-12-06T20:53:59.128ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dced7903-b330-459f-a618-1e457fa2c9aa", "date": "Fri, 06 Dec 2024 20:53:59 GMT"} })
87022024-12-06T20:53:59.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87032024-12-06T20:53:59.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87042024-12-06T20:53:59.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87052024-12-06T20:53:59.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87062024-12-06T20:53:59.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87072024-12-06T20:53:59.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87082024-12-06T20:53:59.136ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87092024-12-06T20:53:59.137ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "75384e70-1c15-4bb8-a6a9-40d83f51c118", "content-length": "134", "date": "Fri, 06 Dec 2024 20:53:58 GMT"} })
87102024-12-06T20:53:59.137ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87112024-12-06T20:53:59.137ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
87122024-12-06T20:53:59.137ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
87132024-12-06T20:53:59.137ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87142024-12-06T20:53:59.137ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87152024-12-06T20:53:59.137ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87162024-12-06T20:53:59.137ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87172024-12-06T20:53:59.137ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87182024-12-06T20:53:59.137ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87192024-12-06T20:53:59.137ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87202024-12-06T20:53:59.138ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
87212024-12-06T20:53:59.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87222024-12-06T20:53:59.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87232024-12-06T20:53:59.156ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87242024-12-06T20:53:59.157ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b023c359-50c7-4530-b2ea-e01be5632f91", "content-length": "691", "date": "Fri, 06 Dec 2024 20:53:59 GMT"} })
87252024-12-06T20:53:59.157ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
87262024-12-06T20:53:59.157ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
87272024-12-06T20:53:59.157ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
87282024-12-06T20:53:59.158ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 304.598553ms iteration = 20 status = {}
87292024-12-06T20:53:59.159ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87302024-12-06T20:53:59.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "44feb2bd-3e77-4fbb-86d5-996bdcdd5509", "content-length": "2", "date": "Fri, 06 Dec 2024 20:53:58 GMT"} })
87312024-12-06T20:53:59.159ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87322024-12-06T20:53:59.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bf1b812-095f-4f96-9de8-918b93b9d44c", "content-length": "52", "date": "Fri, 06 Dec 2024 20:53:58 GMT"} })
87332024-12-06T20:53:59.159ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
87342024-12-06T20:53:59.159ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87352024-12-06T20:53:59.160ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87362024-12-06T20:53:59.160ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87372024-12-06T20:53:59.260ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4ea8f7ee-6810-4821-9b46-a57ace59d7c6", "date": "Fri, 06 Dec 2024 20:53:59 GMT"} })
87382024-12-06T20:53:59.260ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
87392024-12-06T20:53:59.260ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87402024-12-06T20:53:59.261ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac9bed45-f2d6-4f62-9f38-f8cda9a9aa59", "content-length": "682", "date": "Fri, 06 Dec 2024 20:53:59 GMT"} })
87412024-12-06T20:53:59.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87422024-12-06T20:53:59.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87432024-12-06T20:53:59.261ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c06ccb39-7e4b-4367-ae30-d935ae87e2a2", "date": "Fri, 06 Dec 2024 20:53:59 GMT"} })
87442024-12-06T20:53:59.263ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 409.591449ms iteration = 20 status = {}
87452024-12-06T20:53:59.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87462024-12-06T20:53:59.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87472024-12-06T20:53:59.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87482024-12-06T20:53:59.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87492024-12-06T20:53:59.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87502024-12-06T20:53:59.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87512024-12-06T20:53:59.277ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 424.015832ms iteration = 20 status = {}
87522024-12-06T20:53:59.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 252b7539-9e73-4bc6-ab2e-151fda255e28 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87532024-12-06T20:53:59.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 252b7539-9e73-4bc6-ab2e-151fda255e28 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87542024-12-06T20:53:59.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 252b7539-9e73-4bc6-ab2e-151fda255e28 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87552024-12-06T20:54:00.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d2f56dd-4a96-46a4-b3d5-0dc58a865cea roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87562024-12-06T20:54:00.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d2f56dd-4a96-46a4-b3d5-0dc58a865cea resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87572024-12-06T20:54:00.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d2f56dd-4a96-46a4-b3d5-0dc58a865cea response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87582024-12-06T20:54:01.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1e1a1d1c-27d1-48af-91ed-146e5bfe45bb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87592024-12-06T20:54:01.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1e1a1d1c-27d1-48af-91ed-146e5bfe45bb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87602024-12-06T20:54:01.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1e1a1d1c-27d1-48af-91ed-146e5bfe45bb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87612024-12-06T20:54:02.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 438 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 9b6e6591-590d-4c11-a465-d7f8d0444fe3 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
87622024-12-06T20:54:02.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 24f9585d-3c1f-4ae7-a0cb-86459e51ee1a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87632024-12-06T20:54:02.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 24f9585d-3c1f-4ae7-a0cb-86459e51ee1a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87642024-12-06T20:54:02.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 24f9585d-3c1f-4ae7-a0cb-86459e51ee1a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87652024-12-06T20:54:04.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 058ec8b8-50e0-4e0e-bbc7-8e5c8fa2a6c5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87662024-12-06T20:54:04.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 058ec8b8-50e0-4e0e-bbc7-8e5c8fa2a6c5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87672024-12-06T20:54:04.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 058ec8b8-50e0-4e0e-bbc7-8e5c8fa2a6c5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87682024-12-06T20:54:05.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3cde6f7b-84cb-47d7-afe0-59e6937572bc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87692024-12-06T20:54:05.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3cde6f7b-84cb-47d7-afe0-59e6937572bc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87702024-12-06T20:54:05.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3cde6f7b-84cb-47d7-afe0-59e6937572bc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87712024-12-06T20:54:06.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bd02ab1a-2b04-413d-b208-1a6ea84a415c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87722024-12-06T20:54:06.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bd02ab1a-2b04-413d-b208-1a6ea84a415c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87732024-12-06T20:54:06.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bd02ab1a-2b04-413d-b208-1a6ea84a415c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87742024-12-06T20:54:07.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05ff7600-3662-40bd-b2f3-a52631b96663 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87752024-12-06T20:54:07.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05ff7600-3662-40bd-b2f3-a52631b96663 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87762024-12-06T20:54:07.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05ff7600-3662-40bd-b2f3-a52631b96663 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87772024-12-06T20:54:08.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 160ad8ee-9b15-43ed-800f-85b6f7b6c37b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87782024-12-06T20:54:08.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 160ad8ee-9b15-43ed-800f-85b6f7b6c37b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87792024-12-06T20:54:08.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 160ad8ee-9b15-43ed-800f-85b6f7b6c37b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
87802024-12-06T20:54:08.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
87812024-12-06T20:54:08.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
87822024-12-06T20:54:08.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87832024-12-06T20:54:08.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87842024-12-06T20:54:08.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87852024-12-06T20:54:08.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87862024-12-06T20:54:08.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87872024-12-06T20:54:08.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87882024-12-06T20:54:08.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87892024-12-06T20:54:08.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87902024-12-06T20:54:08.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87912024-12-06T20:54:08.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87922024-12-06T20:54:08.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87932024-12-06T20:54:08.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
87942024-12-06T20:54:08.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87952024-12-06T20:54:08.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87962024-12-06T20:54:08.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
87972024-12-06T20:54:08.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.472466ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
87982024-12-06T20:54:08.882ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87992024-12-06T20:54:08.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88002024-12-06T20:54:08.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.611779ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88012024-12-06T20:54:09.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1a1db7e9-a98a-4aab-9a9c-699d3a5eab6b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88022024-12-06T20:54:09.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1a1db7e9-a98a-4aab-9a9c-699d3a5eab6b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88032024-12-06T20:54:09.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1489 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1a1db7e9-a98a-4aab-9a9c-699d3a5eab6b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88042024-12-06T20:54:10.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b4974dad-de40-4ea8-ab0a-2d16e8227f97 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88052024-12-06T20:54:10.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b4974dad-de40-4ea8-ab0a-2d16e8227f97 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88062024-12-06T20:54:10.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b4974dad-de40-4ea8-ab0a-2d16e8227f97 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88072024-12-06T20:54:11.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a0ec6d3-eb89-46de-9677-286773c5eb32 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88082024-12-06T20:54:11.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a0ec6d3-eb89-46de-9677-286773c5eb32 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88092024-12-06T20:54:11.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a0ec6d3-eb89-46de-9677-286773c5eb32 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88102024-12-06T20:54:12.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ff1ef417-b78c-47ce-8216-ce123173bdc9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88112024-12-06T20:54:12.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ff1ef417-b78c-47ce-8216-ce123173bdc9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88122024-12-06T20:54:12.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ff1ef417-b78c-47ce-8216-ce123173bdc9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88132024-12-06T20:54:12.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 525 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = cd85cc28-6472-4788-b132-0d109832a615 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
88142024-12-06T20:54:13.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ff5fd286-741e-4c18-bae0-648c48e192c2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88152024-12-06T20:54:13.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ff5fd286-741e-4c18-bae0-648c48e192c2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88162024-12-06T20:54:13.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ff5fd286-741e-4c18-bae0-648c48e192c2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88172024-12-06T20:54:14.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 87d32696-d962-488e-b5b1-23a031e13ff7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88182024-12-06T20:54:14.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 87d32696-d962-488e-b5b1-23a031e13ff7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88192024-12-06T20:54:14.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 87d32696-d962-488e-b5b1-23a031e13ff7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88202024-12-06T20:54:15.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 72b00b5f-120d-4a21-93a6-bb12f8994bff roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88212024-12-06T20:54:15.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 72b00b5f-120d-4a21-93a6-bb12f8994bff resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88222024-12-06T20:54:15.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 72b00b5f-120d-4a21-93a6-bb12f8994bff response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88232024-12-06T20:54:16.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7f025771-1827-481e-9033-0329fa20414d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88242024-12-06T20:54:16.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7f025771-1827-481e-9033-0329fa20414d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88252024-12-06T20:54:16.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7f025771-1827-481e-9033-0329fa20414d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88262024-12-06T20:54:17.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13644258-b5df-4ef2-9ab8-c2d42d234ead roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88272024-12-06T20:54:17.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13644258-b5df-4ef2-9ab8-c2d42d234ead resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88282024-12-06T20:54:17.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13644258-b5df-4ef2-9ab8-c2d42d234ead response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88292024-12-06T20:54:18.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 96228058-a106-473a-a160-6204be375d01 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88302024-12-06T20:54:18.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 96228058-a106-473a-a160-6204be375d01 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88312024-12-06T20:54:18.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 96228058-a106-473a-a160-6204be375d01 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88322024-12-06T20:54:18.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
88332024-12-06T20:54:18.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
88342024-12-06T20:54:18.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88352024-12-06T20:54:18.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88362024-12-06T20:54:18.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88372024-12-06T20:54:18.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88382024-12-06T20:54:18.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88392024-12-06T20:54:18.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88402024-12-06T20:54:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88412024-12-06T20:54:18.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.571848ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88422024-12-06T20:54:18.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88432024-12-06T20:54:18.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88442024-12-06T20:54:18.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88452024-12-06T20:54:18.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88462024-12-06T20:54:18.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88472024-12-06T20:54:18.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88482024-12-06T20:54:18.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
88492024-12-06T20:54:18.867ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88502024-12-06T20:54:18.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88512024-12-06T20:54:18.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
88522024-12-06T20:54:18.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.550945ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
88532024-12-06T20:54:19.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d645eae-6b20-4a50-8937-2e8bc19ae9f4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88542024-12-06T20:54:19.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d645eae-6b20-4a50-8937-2e8bc19ae9f4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88552024-12-06T20:54:19.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d645eae-6b20-4a50-8937-2e8bc19ae9f4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88562024-12-06T20:54:20.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c3ea00e6-a1bc-42a4-8c98-ab7f990e9e1a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88572024-12-06T20:54:20.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c3ea00e6-a1bc-42a4-8c98-ab7f990e9e1a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88582024-12-06T20:54:20.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c3ea00e6-a1bc-42a4-8c98-ab7f990e9e1a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88592024-12-06T20:54:21.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea1df6ec-c58d-4d8b-b86b-71c57f7cf940 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88602024-12-06T20:54:21.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea1df6ec-c58d-4d8b-b86b-71c57f7cf940 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88612024-12-06T20:54:21.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea1df6ec-c58d-4d8b-b86b-71c57f7cf940 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88622024-12-06T20:54:22.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3429ec6a-8a35-49a4-9a19-e5ad53b28c9c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88632024-12-06T20:54:22.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3429ec6a-8a35-49a4-9a19-e5ad53b28c9c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88642024-12-06T20:54:22.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3429ec6a-8a35-49a4-9a19-e5ad53b28c9c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88652024-12-06T20:54:22.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 483 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 653c4a02-4ad7-449c-afae-79b551c460fd response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
88662024-12-06T20:54:23.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bd492263-9e58-43cd-ac24-ef9ddebaa4dc roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88672024-12-06T20:54:23.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bd492263-9e58-43cd-ac24-ef9ddebaa4dc resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88682024-12-06T20:54:23.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bd492263-9e58-43cd-ac24-ef9ddebaa4dc response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88692024-12-06T20:54:24.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb428f56-0db8-4fd8-8508-9978a8d8a706 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88702024-12-06T20:54:24.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb428f56-0db8-4fd8-8508-9978a8d8a706 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88712024-12-06T20:54:24.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eb428f56-0db8-4fd8-8508-9978a8d8a706 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88722024-12-06T20:54:25.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0f63c4b0-927e-4602-8c9f-c41cd5aea833 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88732024-12-06T20:54:25.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0f63c4b0-927e-4602-8c9f-c41cd5aea833 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88742024-12-06T20:54:25.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0f63c4b0-927e-4602-8c9f-c41cd5aea833 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88752024-12-06T20:54:26.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 12418abb-b374-4445-afb1-f501b5ce335d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88762024-12-06T20:54:26.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 12418abb-b374-4445-afb1-f501b5ce335d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88772024-12-06T20:54:26.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 12418abb-b374-4445-afb1-f501b5ce335d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88782024-12-06T20:54:27.403ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:64821
88792024-12-06T20:54:27.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = ce37de95-243b-4006-b8ae-c506881ea21f roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
88802024-12-06T20:54:27.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = ce37de95-243b-4006-b8ae-c506881ea21f resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
88812024-12-06T20:54:27.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = ce37de95-243b-4006-b8ae-c506881ea21f response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
88822024-12-06T20:54:27.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 5af56bb9-bec4-475f-8156-f9ddfab827be roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
88832024-12-06T20:54:27.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 5af56bb9-bec4-475f-8156-f9ddfab827be resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
88842024-12-06T20:54:27.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 5af56bb9-bec4-475f-8156-f9ddfab827be response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
88852024-12-06T20:54:27.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1678ea44-801d-403f-81bb-7431b3e17c5e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88862024-12-06T20:54:27.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1678ea44-801d-403f-81bb-7431b3e17c5e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88872024-12-06T20:54:27.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1678ea44-801d-403f-81bb-7431b3e17c5e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88882024-12-06T20:54:28.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4bfe5268-67ab-4261-b2b8-e7e086096ee5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88892024-12-06T20:54:28.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4bfe5268-67ab-4261-b2b8-e7e086096ee5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88902024-12-06T20:54:28.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4bfe5268-67ab-4261-b2b8-e7e086096ee5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
88912024-12-06T20:54:28.851ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
88922024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
88932024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
88942024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88952024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88962024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
88972024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
88982024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
88992024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
89002024-12-06T20:54:28.852ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:44:28.852041184 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
89012024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89022024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
89032024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
89042024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
89052024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
89062024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
89072024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89082024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89092024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89102024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89112024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
89122024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89132024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
89142024-12-06T20:54:28.852ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
89152024-12-06T20:54:28.852ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
89162024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
89172024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
89182024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89192024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
89202024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
89212024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
89222024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89232024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
89242024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89252024-12-06T20:54:28.852ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
89262024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89272024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
89282024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89292024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
89302024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
89312024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
89322024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89332024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
89342024-12-06T20:54:28.852ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
89352024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.41\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
89362024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
89372024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
89382024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
89392024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
89402024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89412024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89422024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
89432024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89442024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
89452024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89462024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
89472024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89482024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
89492024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89502024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89512024-12-06T20:54:28.852ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
89522024-12-06T20:54:28.853ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89532024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89542024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
89552024-12-06T20:54:28.853ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
89562024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89572024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
89582024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
89592024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89602024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
89612024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
89622024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
89632024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
89642024-12-06T20:54:28.853ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
89652024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89662024-12-06T20:54:28.853ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6799, tv_nsec: 193274973 } })
89672024-12-06T20:54:28.853ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6799, tv_nsec: 193277633 } })
89682024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89692024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89702024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89712024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89722024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89732024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89742024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89752024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89762024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89772024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89782024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89792024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89802024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89812024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89822024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89832024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89842024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
89852024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89862024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89872024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
89882024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89892024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89902024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
89912024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.694824ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
89922024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
89932024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.620062ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
89942024-12-06T20:54:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89952024-12-06T20:54:28.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89962024-12-06T20:54:28.856ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:44:28.852041184 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
89972024-12-06T20:54:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.269251ms iteration = 11 status = {"expiration":"2024-12-06T20:44:28.852041184Z","pruned":[]}
89982024-12-06T20:54:28.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6799, tv_nsec: 197135143 } })
89992024-12-06T20:54:28.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
90002024-12-06T20:54:28.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90012024-12-06T20:54:28.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
90022024-12-06T20:54:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90032024-12-06T20:54:28.858ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.255225ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
90042024-12-06T20:54:28.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90052024-12-06T20:54:28.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90062024-12-06T20:54:28.860ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90072024-12-06T20:54:28.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90082024-12-06T20:54:28.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90092024-12-06T20:54:28.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90102024-12-06T20:54:28.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
90112024-12-06T20:54:28.863ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90122024-12-06T20:54:28.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
90132024-12-06T20:54:28.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90142024-12-06T20:54:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90152024-12-06T20:54:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90162024-12-06T20:54:28.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90172024-12-06T20:54:28.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6799, tv_nsec: 209000988 } })
90182024-12-06T20:54:28.869ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
90192024-12-06T20:54:28.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90202024-12-06T20:54:28.870ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90212024-12-06T20:54:28.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90222024-12-06T20:54:28.871ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.59243ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
90232024-12-06T20:54:28.872ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90242024-12-06T20:54:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90252024-12-06T20:54:28.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90262024-12-06T20:54:28.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90272024-12-06T20:54:28.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90282024-12-06T20:54:28.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90292024-12-06T20:54:28.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90302024-12-06T20:54:28.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90312024-12-06T20:54:28.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90322024-12-06T20:54:28.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.545023ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
90332024-12-06T20:54:28.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90342024-12-06T20:54:28.931ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90352024-12-06T20:54:28.931ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
90362024-12-06T20:54:28.931ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 79.216213ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
90372024-12-06T20:54:28.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
90382024-12-06T20:54:28.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90392024-12-06T20:54:28.932ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90402024-12-06T20:54:28.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90412024-12-06T20:54:28.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90422024-12-06T20:54:28.932ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90432024-12-06T20:54:28.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90442024-12-06T20:54:28.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.451324ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
90452024-12-06T20:54:28.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90462024-12-06T20:54:28.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
90472024-12-06T20:54:28.935ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90482024-12-06T20:54:28.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90492024-12-06T20:54:28.936ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90502024-12-06T20:54:28.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90512024-12-06T20:54:28.936ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90522024-12-06T20:54:28.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90532024-12-06T20:54:28.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90542024-12-06T20:54:28.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90552024-12-06T20:54:28.937ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90562024-12-06T20:54:28.938ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90572024-12-06T20:54:28.938ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90582024-12-06T20:54:28.938ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
90592024-12-06T20:54:28.938ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90602024-12-06T20:54:28.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90612024-12-06T20:54:28.940ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90622024-12-06T20:54:28.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90632024-12-06T20:54:28.940ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90642024-12-06T20:54:28.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90652024-12-06T20:54:28.942ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90662024-12-06T20:54:28.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90672024-12-06T20:54:28.943ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90682024-12-06T20:54:28.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
90692024-12-06T20:54:28.943ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90702024-12-06T20:54:28.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90712024-12-06T20:54:28.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90722024-12-06T20:54:28.944ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6799, tv_nsec: 284250658 } })
90732024-12-06T20:54:28.945ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
90742024-12-06T20:54:28.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90752024-12-06T20:54:28.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90762024-12-06T20:54:28.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90772024-12-06T20:54:28.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90782024-12-06T20:54:28.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90792024-12-06T20:54:28.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90802024-12-06T20:54:28.952ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 99.645509ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90812024-12-06T20:54:28.955ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
90822024-12-06T20:54:28.955ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
90832024-12-06T20:54:28.955ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 102.208355ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
90842024-12-06T20:54:28.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90852024-12-06T20:54:28.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90862024-12-06T20:54:28.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90872024-12-06T20:54:28.958ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
90882024-12-06T20:54:28.958ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
90892024-12-06T20:54:28.958ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 105.352056ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
90902024-12-06T20:54:28.961ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90912024-12-06T20:54:28.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90922024-12-06T20:54:28.973ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90932024-12-06T20:54:28.998ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
90942024-12-06T20:54:28.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
90952024-12-06T20:54:29.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90962024-12-06T20:54:29.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90972024-12-06T20:54:29.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90982024-12-06T20:54:29.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90992024-12-06T20:54:29.015ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
91002024-12-06T20:54:29.016ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
91012024-12-06T20:54:29.016ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
91022024-12-06T20:54:29.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91032024-12-06T20:54:29.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91042024-12-06T20:54:29.017ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
91052024-12-06T20:54:29.017ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91062024-12-06T20:54:29.018ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9665869a-c94f-4c23-906c-b40994fac302", "content-length": "26", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
91072024-12-06T20:54:29.018ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91082024-12-06T20:54:29.020ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91092024-12-06T20:54:29.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91102024-12-06T20:54:29.024ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
91112024-12-06T20:54:29.024ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
91122024-12-06T20:54:29.024ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
91132024-12-06T20:54:29.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91142024-12-06T20:54:29.024ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91152024-12-06T20:54:29.024ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
91162024-12-06T20:54:29.024ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91172024-12-06T20:54:29.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91182024-12-06T20:54:29.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91192024-12-06T20:54:29.025ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
91202024-12-06T20:54:29.025ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 172.854416ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
91212024-12-06T20:54:29.026ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91222024-12-06T20:54:29.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91232024-12-06T20:54:29.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91242024-12-06T20:54:29.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
91252024-12-06T20:54:29.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91262024-12-06T20:54:29.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91272024-12-06T20:54:29.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91282024-12-06T20:54:29.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91292024-12-06T20:54:29.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91302024-12-06T20:54:29.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91312024-12-06T20:54:29.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91322024-12-06T20:54:29.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 180.136554ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
91332024-12-06T20:54:29.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 180.673488ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
91342024-12-06T20:54:29.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91352024-12-06T20:54:29.038ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91362024-12-06T20:54:29.038ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91372024-12-06T20:54:29.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91382024-12-06T20:54:29.051ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
91392024-12-06T20:54:29.051ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91402024-12-06T20:54:29.053ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "475ac4b3-0c4e-4494-aa70-355edc86e983", "content-length": "26", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
91412024-12-06T20:54:29.053ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91422024-12-06T20:54:29.055ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91432024-12-06T20:54:29.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91442024-12-06T20:54:29.061ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
91452024-12-06T20:54:29.061ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 209.318976ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
91462024-12-06T20:54:29.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91472024-12-06T20:54:29.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91482024-12-06T20:54:29.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91492024-12-06T20:54:29.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91502024-12-06T20:54:29.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91512024-12-06T20:54:29.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91522024-12-06T20:54:29.072ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91532024-12-06T20:54:29.072ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
91542024-12-06T20:54:29.072ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 220.072023ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
91552024-12-06T20:54:29.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
91562024-12-06T20:54:29.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91572024-12-06T20:54:29.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91582024-12-06T20:54:29.085ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 232.38537ms iteration = 21 status = 0
91592024-12-06T20:54:29.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 234.534776ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
91602024-12-06T20:54:29.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91612024-12-06T20:54:29.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91622024-12-06T20:54:29.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91632024-12-06T20:54:29.100ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
91642024-12-06T20:54:29.100ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
91652024-12-06T20:54:29.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91662024-12-06T20:54:29.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91672024-12-06T20:54:29.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
91682024-12-06T20:54:29.102ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
91692024-12-06T20:54:29.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
91702024-12-06T20:54:29.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91712024-12-06T20:54:29.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91722024-12-06T20:54:29.109ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91732024-12-06T20:54:29.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91742024-12-06T20:54:29.114ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) }
91752024-12-06T20:54:29.114ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 262.319353ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
91762024-12-06T20:54:29.123ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
91772024-12-06T20:54:29.123ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
91782024-12-06T20:54:29.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91792024-12-06T20:54:29.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91802024-12-06T20:54:29.131ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
91812024-12-06T20:54:29.141ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 288.461637ms iteration = 23 status = {"physical_disks_added":0}
91822024-12-06T20:54:29.156ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
91832024-12-06T20:54:29.156ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 303.286159ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
91842024-12-06T20:54:29.175ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
91852024-12-06T20:54:29.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91862024-12-06T20:54:29.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91872024-12-06T20:54:29.295ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
91882024-12-06T20:54:29.295ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91892024-12-06T20:54:29.295ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b36832df-c577-45f5-bbd3-e08fde67ce93", "content-length": "26", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
91902024-12-06T20:54:29.295ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91912024-12-06T20:54:29.297ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
91922024-12-06T20:54:29.308ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
91932024-12-06T20:54:29.308ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "db80d88c-adf8-4bf5-b747-773463c28989", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91942024-12-06T20:54:29.308ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91952024-12-06T20:54:29.310ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bf24c2c3-fd6e-4487-bf9d-90832ed6c2ec", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91962024-12-06T20:54:29.310ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91972024-12-06T20:54:29.312ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5424a82f-54f3-47ce-a653-3f35b6cd59d4", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91982024-12-06T20:54:29.312ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91992024-12-06T20:54:29.314ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92002024-12-06T20:54:29.314ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 462.76588ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
92012024-12-06T20:54:29.328ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 475.385166ms iteration = 21 status = {}
92022024-12-06T20:54:29.332ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92032024-12-06T20:54:29.333ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b74624a5-db0b-45bc-b86c-5c7609c2c4ee", "content-length": "1", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
92042024-12-06T20:54:29.335ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92052024-12-06T20:54:29.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92062024-12-06T20:54:29.363ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
92072024-12-06T20:54:29.363ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92082024-12-06T20:54:29.367ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "08a2fc6e-3b88-44cd-97b6-e9f5421b2713", "content-length": "372", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
92092024-12-06T20:54:29.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92102024-12-06T20:54:29.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92112024-12-06T20:54:29.368ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
92122024-12-06T20:54:29.369ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ce8f8550-30e4-4066-98a5-aa9c553b4894", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92132024-12-06T20:54:29.369ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92142024-12-06T20:54:29.371ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
92152024-12-06T20:54:29.371ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
92162024-12-06T20:54:29.371ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
92172024-12-06T20:54:29.371ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 519.136534ms iteration = 11 status = {"generation":2}
92182024-12-06T20:54:29.371ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92192024-12-06T20:54:29.371ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b72b9ba1-9523-4a84-9579-5ae8dd786a2e", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92202024-12-06T20:54:29.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92212024-12-06T20:54:29.371ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92222024-12-06T20:54:29.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92232024-12-06T20:54:29.373ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 521.384082ms iteration = 21 status = null
92242024-12-06T20:54:29.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92252024-12-06T20:54:29.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92262024-12-06T20:54:29.374ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
92272024-12-06T20:54:29.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 522.298765ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
92282024-12-06T20:54:29.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92292024-12-06T20:54:29.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92302024-12-06T20:54:29.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92312024-12-06T20:54:29.375ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92322024-12-06T20:54:29.377ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
92332024-12-06T20:54:29.378ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
92342024-12-06T20:54:29.378ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
92352024-12-06T20:54:29.378ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 525.95876ms iteration = 11 status = {"generation":1}
92362024-12-06T20:54:29.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
92372024-12-06T20:54:29.379ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92382024-12-06T20:54:29.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92392024-12-06T20:54:29.382ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92402024-12-06T20:54:29.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92412024-12-06T20:54:29.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92422024-12-06T20:54:29.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92432024-12-06T20:54:29.387ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92442024-12-06T20:54:29.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92452024-12-06T20:54:29.389ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92462024-12-06T20:54:29.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92472024-12-06T20:54:29.391ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92482024-12-06T20:54:29.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92492024-12-06T20:54:29.394ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92502024-12-06T20:54:29.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92512024-12-06T20:54:29.406ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92522024-12-06T20:54:29.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92532024-12-06T20:54:29.409ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92542024-12-06T20:54:29.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92552024-12-06T20:54:29.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92562024-12-06T20:54:29.414ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92572024-12-06T20:54:29.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92582024-12-06T20:54:29.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92592024-12-06T20:54:29.431ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
92602024-12-06T20:54:29.431ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
92612024-12-06T20:54:29.431ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fef77e00-54e8-46da-9f6f-494fe6b3b0ad", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
92622024-12-06T20:54:29.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92632024-12-06T20:54:29.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92642024-12-06T20:54:29.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92652024-12-06T20:54:29.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92662024-12-06T20:54:29.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92672024-12-06T20:54:29.439ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92682024-12-06T20:54:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92692024-12-06T20:54:29.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
92702024-12-06T20:54:29.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92712024-12-06T20:54:29.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92722024-12-06T20:54:29.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92732024-12-06T20:54:29.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92742024-12-06T20:54:29.446ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
92752024-12-06T20:54:29.446ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92762024-12-06T20:54:29.446ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92772024-12-06T20:54:29.446ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d2db2801-765d-40ae-afd0-8277611ed835", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
92782024-12-06T20:54:29.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92792024-12-06T20:54:29.449ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 596.777075ms iteration = 21 status = {}
92802024-12-06T20:54:29.450ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92812024-12-06T20:54:29.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92822024-12-06T20:54:29.452ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92832024-12-06T20:54:29.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92842024-12-06T20:54:29.454ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92852024-12-06T20:54:29.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92862024-12-06T20:54:29.456ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92872024-12-06T20:54:29.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92882024-12-06T20:54:29.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92892024-12-06T20:54:29.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92902024-12-06T20:54:29.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92912024-12-06T20:54:29.463ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
92922024-12-06T20:54:29.463ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92932024-12-06T20:54:29.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92942024-12-06T20:54:29.465ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
92952024-12-06T20:54:29.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92962024-12-06T20:54:29.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92972024-12-06T20:54:29.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
92982024-12-06T20:54:29.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
92992024-12-06T20:54:29.468ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93002024-12-06T20:54:29.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93012024-12-06T20:54:29.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93022024-12-06T20:54:29.474ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
93032024-12-06T20:54:29.474ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93042024-12-06T20:54:29.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93052024-12-06T20:54:29.478ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93062024-12-06T20:54:29.478ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "17adbe3f-50e7-46dc-9bde-a6b440b0f4ef", "content-length": "134", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
93072024-12-06T20:54:29.478ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
93082024-12-06T20:54:29.478ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
93092024-12-06T20:54:29.479ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93102024-12-06T20:54:29.479ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93112024-12-06T20:54:29.479ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93122024-12-06T20:54:29.479ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93132024-12-06T20:54:29.479ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93142024-12-06T20:54:29.479ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93152024-12-06T20:54:29.479ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93162024-12-06T20:54:29.479ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93172024-12-06T20:54:29.479ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
93182024-12-06T20:54:29.479ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93192024-12-06T20:54:29.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93202024-12-06T20:54:29.480ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93212024-12-06T20:54:29.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93222024-12-06T20:54:29.482ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93232024-12-06T20:54:29.482ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "496a4e4f-ffc9-4d72-8b4e-90bfcdaf059a", "content-length": "2", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
93242024-12-06T20:54:29.482ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93252024-12-06T20:54:29.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93262024-12-06T20:54:29.482ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "afc303e3-ec27-4531-8f34-07a0306fc19d", "content-length": "52", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
93272024-12-06T20:54:29.482ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
93282024-12-06T20:54:29.482ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93292024-12-06T20:54:29.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93302024-12-06T20:54:29.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93312024-12-06T20:54:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93322024-12-06T20:54:29.487ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93332024-12-06T20:54:29.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93342024-12-06T20:54:29.491ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93352024-12-06T20:54:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93362024-12-06T20:54:29.493ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93372024-12-06T20:54:29.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93382024-12-06T20:54:29.495ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93392024-12-06T20:54:29.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93402024-12-06T20:54:29.497ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93412024-12-06T20:54:29.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
93422024-12-06T20:54:29.503ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93432024-12-06T20:54:29.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93442024-12-06T20:54:29.522ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93452024-12-06T20:54:29.522ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3aec8669-9d9b-4408-a3ce-5a9e015f116b", "content-length": "691", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
93462024-12-06T20:54:29.522ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
93472024-12-06T20:54:29.522ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
93482024-12-06T20:54:29.522ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
93492024-12-06T20:54:29.524ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 671.44185ms iteration = 21 status = {}
93502024-12-06T20:54:29.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9a81b14b-5731-4101-8f77-9d41c61c4145 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
93512024-12-06T20:54:29.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9a81b14b-5731-4101-8f77-9d41c61c4145 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
93522024-12-06T20:54:29.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9a81b14b-5731-4101-8f77-9d41c61c4145 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
93532024-12-06T20:54:29.550ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93542024-12-06T20:54:29.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93552024-12-06T20:54:29.552ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93562024-12-06T20:54:29.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93572024-12-06T20:54:29.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93582024-12-06T20:54:29.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
93592024-12-06T20:54:29.593ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93602024-12-06T20:54:29.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93612024-12-06T20:54:29.600ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e75e9ede-bef7-4a68-adff-96a00bc20eb7", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
93622024-12-06T20:54:29.600ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
93632024-12-06T20:54:29.600ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93642024-12-06T20:54:29.601ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
93652024-12-06T20:54:29.601ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93662024-12-06T20:54:29.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93672024-12-06T20:54:29.603ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93682024-12-06T20:54:29.604ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e10852c-2ad4-4ab5-8d45-438fd9854380", "content-length": "682", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
93692024-12-06T20:54:29.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93702024-12-06T20:54:29.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93712024-12-06T20:54:29.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
93722024-12-06T20:54:29.605ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93732024-12-06T20:54:29.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93742024-12-06T20:54:29.607ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
93752024-12-06T20:54:29.607ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 525aa886-e2b8-42b8-b1c9-cbf16e16e174, kind: Service { id: 59b92633-3550-4af1-b628-503b6bafd00d }, name: Name("external-dns-59b92633-3550-4af1-b628-503b6bafd00d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 169])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7ff7e7d1-13cc-4538-9fce-dfd74792a288, kind: Service { id: 9d99eda0-389f-44c6-94ee-e9e7a03c9733 }, name: Name("external-dns-9d99eda0-389f-44c6-94ee-e9e7a03c9733"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 96])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 176e274c-5ddd-4aa2-b53c-05e8fe632337, kind: Service { id: 3965e738-3305-4fcd-9da0-4c6e0ce7edc1 }, name: Name("nexus-3965e738-3305-4fcd-9da0-4c6e0ce7edc1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 75143dec-1fa4-42e5-a888-c77d19a4a83f, kind: Service { id: e9fe68b0-d53c-4161-a621-681677d5b0d6 }, name: Name("nexus-e9fe68b0-d53c-4161-a621-681677d5b0d6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9a966830-c35d-4c5c-bab6-585ffc135908, kind: Service { id: fd12fb4f-e62d-4cab-a4bd-2024f2546d3b }, name: Name("nexus-fd12fb4f-e62d-4cab-a4bd-2024f2546d3b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 18])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
93762024-12-06T20:54:29.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93772024-12-06T20:54:29.607ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
93782024-12-06T20:54:29.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93792024-12-06T20:54:29.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93802024-12-06T20:54:29.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93812024-12-06T20:54:29.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93822024-12-06T20:54:29.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93832024-12-06T20:54:29.621ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 768.767009ms iteration = 21 status = {}
93842024-12-06T20:54:29.660ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 0a667526-2006-419e-9b68-c251fd138c06, time_created: 2024-12-06T20:44:28.288040Z, time_modified: 2024-12-06T20:44:28.288040Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
93852024-12-06T20:54:29.660ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
93862024-12-06T20:54:29.660ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93872024-12-06T20:54:29.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93882024-12-06T20:54:29.662ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
93892024-12-06T20:54:29.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
93902024-12-06T20:54:29.663ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93912024-12-06T20:54:29.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
93922024-12-06T20:54:29.697ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
93932024-12-06T20:54:29.698ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "40937823-1889-4b8b-9de2-3e1f89903b83", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
93942024-12-06T20:54:29.700ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
93952024-12-06T20:54:29.700ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 847.919539ms
93962024-12-06T20:54:29.700ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 847.9296ms iteration = 3 status = {}
93972024-12-06T20:54:30.052ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
93982024-12-06T20:54:30.052ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
93992024-12-06T20:54:30.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94002024-12-06T20:54:30.055ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94012024-12-06T20:54:30.057ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
94022024-12-06T20:54:30.057ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94032024-12-06T20:54:30.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94042024-12-06T20:54:30.065ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(41a67490-8518-44d1-a8f0-5557286ce094, 0), (e2317a09-a835-43fb-93bc-32778a07ae14, 0), (383c32ae-f7aa-4264-aa5c-56951e0eb3cf, 0), (4a01979e-4658-4fa1-bf58-f1c242f05be2, 0)] collection_id = 41a67490-8518-44d1-a8f0-5557286ce094
94052024-12-06T20:54:30.065ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94062024-12-06T20:54:30.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94072024-12-06T20:54:30.177ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 41a67490-8518-44d1-a8f0-5557286ce094 file = nexus/db-queries/src/db/datastore/inventory.rs:1452 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
94082024-12-06T20:54:30.177ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94092024-12-06T20:54:30.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94102024-12-06T20:54:30.185ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(e2317a09-a835-43fb-93bc-32778a07ae14, 0), (383c32ae-f7aa-4264-aa5c-56951e0eb3cf, 0), (4a01979e-4658-4fa1-bf58-f1c242f05be2, 0)]
94112024-12-06T20:54:30.185ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6800, tv_nsec: 526077203 } })
94122024-12-06T20:54:30.221ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
94132024-12-06T20:54:30.222ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
94142024-12-06T20:54:30.222ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
94152024-12-06T20:54:30.222ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "96086007-6dca-4800-ae95-75590453fd52", "content-length": "476", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
94162024-12-06T20:54:30.222ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
94172024-12-06T20:54:30.222ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "005d451f-c124-4c8f-96db-e70d0250200d", "content-length": "734", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
94182024-12-06T20:54:30.222ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
94192024-12-06T20:54:30.223ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d626d7b-9b8b-4688-8e68-011a2ceb9b15", "content-length": "111", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
94202024-12-06T20:54:30.223ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
94212024-12-06T20:54:30.223ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "355ae560-2806-4b07-a3da-c63947928def", "content-length": "111", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
94222024-12-06T20:54:30.223ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
94232024-12-06T20:54:30.223ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0999ba76-795a-4f06-beb2-7ff1732f42df", "content-length": "167", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
94242024-12-06T20:54:30.223ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
94252024-12-06T20:54:30.224ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "314fe339-0310-4175-991c-f73a80b2aade", "content-length": "167", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
94262024-12-06T20:54:30.224ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
94272024-12-06T20:54:30.224ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d0001e8-62fb-49d6-adfb-45a7066e3ebc", "content-length": "175", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
94282024-12-06T20:54:30.224ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
94292024-12-06T20:54:30.224ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fdf65d4-4e5d-42fc-a959-1ac332fa14a6", "content-length": "175", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
94302024-12-06T20:54:30.224ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
94312024-12-06T20:54:30.224ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "949f064f-9603-4ae7-8f1a-759313b7eef6", "content-length": "702", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
94322024-12-06T20:54:30.224ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
94332024-12-06T20:54:30.225ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "48acf699-eec0-4f99-a387-b7aad68b3fe6", "content-length": "727", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94342024-12-06T20:54:30.225ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
94352024-12-06T20:54:30.225ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "232c9fae-7488-44b2-a9f9-39b8aa7b645e", "content-length": "729", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94362024-12-06T20:54:30.225ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
94372024-12-06T20:54:30.225ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "79b7dc9d-cd61-40d8-9fbb-b9c19ccb8344", "content-length": "728", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94382024-12-06T20:54:30.225ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
94392024-12-06T20:54:30.226ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a05c5b5-5a1b-4f33-bef6-4d0c9d268ec5", "content-length": "722", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94402024-12-06T20:54:30.226ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
94412024-12-06T20:54:30.226ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "00614a36-7594-4d42-a390-1bd476d11a99", "content-length": "109", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94422024-12-06T20:54:30.226ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
94432024-12-06T20:54:30.228ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc0c917c-77af-4df8-8003-758d72784fc9", "content-length": "109", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94442024-12-06T20:54:30.228ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
94452024-12-06T20:54:30.229ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4da822bf-9c81-4f7d-bbcb-bb9d50fc3059", "content-length": "169", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94462024-12-06T20:54:30.229ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
94472024-12-06T20:54:30.229ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e37ade9-564c-4ce7-ae5a-d61260cde9a6", "content-length": "169", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94482024-12-06T20:54:30.229ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
94492024-12-06T20:54:30.229ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d04c1f6-f698-4b36-9f72-2582fa094366", "content-length": "178", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94502024-12-06T20:54:30.229ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
94512024-12-06T20:54:30.230ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a0a9f35-e4b5-4558-982f-04631fb256cf", "content-length": "178", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94522024-12-06T20:54:30.230ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
94532024-12-06T20:54:30.230ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "34c22f8a-41c4-4af2-a7c2-e1e9e903fdfe", "content-length": "702", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94542024-12-06T20:54:30.230ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
94552024-12-06T20:54:30.230ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "416b10ef-8f3a-4faa-adea-0c726b56a741", "content-length": "727", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94562024-12-06T20:54:30.230ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
94572024-12-06T20:54:30.230ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9e2ebc4-638e-4b2e-a01b-1a0bc9dc2a48", "content-length": "729", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94582024-12-06T20:54:30.230ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
94592024-12-06T20:54:30.230ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f6a5dc7-1f21-4895-890f-b263d6d45071", "content-length": "728", "date": "Fri, 06 Dec 2024 20:54:30 GMT"} })
94602024-12-06T20:54:30.230ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94612024-12-06T20:54:30.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94622024-12-06T20:54:30.233ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94632024-12-06T20:54:30.236ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
94642024-12-06T20:54:30.236ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94652024-12-06T20:54:30.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94662024-12-06T20:54:30.239ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94672024-12-06T20:54:30.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
94682024-12-06T20:54:30.242ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94692024-12-06T20:54:30.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94702024-12-06T20:54:30.353ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
94712024-12-06T20:54:30.353ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
94722024-12-06T20:54:30.546ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2757485-b1e1-4cfa-a539-a097233ca084", "content-length": "30794", "date": "Fri, 06 Dec 2024 20:54:29 GMT"} })
94732024-12-06T20:54:30.548ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
94742024-12-06T20:54:30.548ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
94752024-12-06T20:54:30.548ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
94762024-12-06T20:54:30.550ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94772024-12-06T20:54:30.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94782024-12-06T20:54:30.552ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94792024-12-06T20:54:30.553ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
94802024-12-06T20:54:30.553ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
94812024-12-06T20:54:30.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
94822024-12-06T20:54:30.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de99e867-088a-4074-acf4-9c52329c53db roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
94832024-12-06T20:54:30.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de99e867-088a-4074-acf4-9c52329c53db resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
94842024-12-06T20:54:30.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = de99e867-088a-4074-acf4-9c52329c53db response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
94852024-12-06T20:54:30.724ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 851a49fb-7410-49c7-8c64-8ae19d01340b file = nexus/db-queries/src/db/datastore/inventory.rs:1006
94862024-12-06T20:54:30.724ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 851a49fb-7410-49c7-8c64-8ae19d01340b time_started = 2024-12-06 20:54:30.221955 UTC
94872024-12-06T20:54:30.724ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 671.510621ms iteration = 3 status = {"collection_id":"851a49fb-7410-49c7-8c64-8ae19d01340b","time_done":"2024-12-06 20:54:30.548245 UTC","time_started":"2024-12-06 20:54:30.221955 UTC"}
94882024-12-06T20:54:30.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
94892024-12-06T20:54:30.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94902024-12-06T20:54:30.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94912024-12-06T20:54:30.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94922024-12-06T20:54:30.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94932024-12-06T20:54:30.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94942024-12-06T20:54:30.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94952024-12-06T20:54:30.730ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94962024-12-06T20:54:30.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94972024-12-06T20:54:30.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94982024-12-06T20:54:30.733ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94992024-12-06T20:54:30.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95002024-12-06T20:54:30.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95012024-12-06T20:54:30.753ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 29.405918ms iteration = 24 status = {"physical_disks_added":0}
95022024-12-06T20:54:31.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5cbdc2bf-0ecc-44ef-a9eb-f05a119f93dd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95032024-12-06T20:54:31.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5cbdc2bf-0ecc-44ef-a9eb-f05a119f93dd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95042024-12-06T20:54:31.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5cbdc2bf-0ecc-44ef-a9eb-f05a119f93dd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95052024-12-06T20:54:32.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 549 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 2b1486ff-c47a-41c1-be40-3cbe3bc163b5 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
95062024-12-06T20:54:32.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 531d319f-4fcd-411b-99ba-65c5c8a08239 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95072024-12-06T20:54:32.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 531d319f-4fcd-411b-99ba-65c5c8a08239 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95082024-12-06T20:54:32.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 531d319f-4fcd-411b-99ba-65c5c8a08239 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95092024-12-06T20:54:33.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2f42e884-b943-4155-b556-5265c410e4d3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95102024-12-06T20:54:33.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2f42e884-b943-4155-b556-5265c410e4d3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95112024-12-06T20:54:33.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2f42e884-b943-4155-b556-5265c410e4d3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95122024-12-06T20:54:34.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 61a31cb2-4115-4a0c-8f6e-54f521a0e6f1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95132024-12-06T20:54:34.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 61a31cb2-4115-4a0c-8f6e-54f521a0e6f1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95142024-12-06T20:54:34.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 61a31cb2-4115-4a0c-8f6e-54f521a0e6f1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95152024-12-06T20:54:35.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8adc9f0a-5658-4af9-981c-2a7a39a4f60a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95162024-12-06T20:54:35.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8adc9f0a-5658-4af9-981c-2a7a39a4f60a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95172024-12-06T20:54:35.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8adc9f0a-5658-4af9-981c-2a7a39a4f60a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95182024-12-06T20:54:36.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 90ac9011-7065-4a17-8721-12873deb5057 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95192024-12-06T20:54:36.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 90ac9011-7065-4a17-8721-12873deb5057 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95202024-12-06T20:54:36.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 90ac9011-7065-4a17-8721-12873deb5057 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95212024-12-06T20:54:37.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 41b2c44f-6ca1-4e67-b223-36cae3dd6bad roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95222024-12-06T20:54:37.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 41b2c44f-6ca1-4e67-b223-36cae3dd6bad resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95232024-12-06T20:54:37.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 41b2c44f-6ca1-4e67-b223-36cae3dd6bad response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95242024-12-06T20:54:38.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 01dedfe4-0510-4411-a05e-3c28b90cac4e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95252024-12-06T20:54:38.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 01dedfe4-0510-4411-a05e-3c28b90cac4e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95262024-12-06T20:54:38.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 01dedfe4-0510-4411-a05e-3c28b90cac4e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95272024-12-06T20:54:38.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
95282024-12-06T20:54:38.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
95292024-12-06T20:54:38.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95302024-12-06T20:54:38.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95312024-12-06T20:54:38.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95322024-12-06T20:54:38.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95332024-12-06T20:54:38.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95342024-12-06T20:54:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95352024-12-06T20:54:38.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95362024-12-06T20:54:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95372024-12-06T20:54:38.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95382024-12-06T20:54:38.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95392024-12-06T20:54:38.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95402024-12-06T20:54:38.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
95412024-12-06T20:54:38.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95422024-12-06T20:54:38.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95432024-12-06T20:54:38.877ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
95442024-12-06T20:54:38.877ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.173619ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
95452024-12-06T20:54:38.888ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95462024-12-06T20:54:38.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95472024-12-06T20:54:38.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.824102ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95482024-12-06T20:54:39.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1fbc2a4c-c018-41cb-91ab-522a597caaa1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95492024-12-06T20:54:39.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1fbc2a4c-c018-41cb-91ab-522a597caaa1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95502024-12-06T20:54:39.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1fbc2a4c-c018-41cb-91ab-522a597caaa1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95512024-12-06T20:54:40.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c40a4d4a-4d5b-4454-9f91-e610bcae5010 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95522024-12-06T20:54:40.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c40a4d4a-4d5b-4454-9f91-e610bcae5010 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95532024-12-06T20:54:40.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c40a4d4a-4d5b-4454-9f91-e610bcae5010 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95542024-12-06T20:54:41.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8ee436cd-acf8-4d5e-b5e0-1033a5c7c86a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95552024-12-06T20:54:41.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8ee436cd-acf8-4d5e-b5e0-1033a5c7c86a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95562024-12-06T20:54:41.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8ee436cd-acf8-4d5e-b5e0-1033a5c7c86a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95572024-12-06T20:54:42.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 500 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = df68f016-d5af-40ac-b877-bd8a270290f2 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
95582024-12-06T20:54:42.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 14f35089-9127-4792-9010-ac7b0599928f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95592024-12-06T20:54:42.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 14f35089-9127-4792-9010-ac7b0599928f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95602024-12-06T20:54:42.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 14f35089-9127-4792-9010-ac7b0599928f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95612024-12-06T20:54:43.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ed86071c-157b-4a56-9b65-72fce378f1f6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95622024-12-06T20:54:43.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ed86071c-157b-4a56-9b65-72fce378f1f6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95632024-12-06T20:54:43.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ed86071c-157b-4a56-9b65-72fce378f1f6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95642024-12-06T20:54:44.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aade2360-7ba2-448c-a7f3-8b9fe491b22f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95652024-12-06T20:54:44.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aade2360-7ba2-448c-a7f3-8b9fe491b22f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95662024-12-06T20:54:44.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aade2360-7ba2-448c-a7f3-8b9fe491b22f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95672024-12-06T20:54:45.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce71574a-6176-4817-825f-a54fcbd574cd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95682024-12-06T20:54:45.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce71574a-6176-4817-825f-a54fcbd574cd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95692024-12-06T20:54:45.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce71574a-6176-4817-825f-a54fcbd574cd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95702024-12-06T20:54:46.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 19cc0cf6-4bd5-44d5-b747-a4020fdd3b28 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95712024-12-06T20:54:46.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 19cc0cf6-4bd5-44d5-b747-a4020fdd3b28 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95722024-12-06T20:54:46.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 19cc0cf6-4bd5-44d5-b747-a4020fdd3b28 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95732024-12-06T20:54:47.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8d17b84-14f3-4509-b124-5132105f05e1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95742024-12-06T20:54:47.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8d17b84-14f3-4509-b124-5132105f05e1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95752024-12-06T20:54:47.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8d17b84-14f3-4509-b124-5132105f05e1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95762024-12-06T20:54:48.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
95772024-12-06T20:54:48.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95782024-12-06T20:54:48.853ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
95792024-12-06T20:54:48.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95802024-12-06T20:54:48.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95812024-12-06T20:54:48.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95822024-12-06T20:54:48.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95832024-12-06T20:54:48.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95842024-12-06T20:54:48.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95852024-12-06T20:54:48.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95862024-12-06T20:54:48.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95872024-12-06T20:54:48.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95882024-12-06T20:54:48.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95892024-12-06T20:54:48.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95902024-12-06T20:54:48.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95912024-12-06T20:54:48.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
95922024-12-06T20:54:48.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95932024-12-06T20:54:48.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95942024-12-06T20:54:48.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
95952024-12-06T20:54:48.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.15656ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
95962024-12-06T20:54:48.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.0542ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95972024-12-06T20:54:48.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8cc123d6-b6d0-464b-b76f-0cdea51800da roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95982024-12-06T20:54:48.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8cc123d6-b6d0-464b-b76f-0cdea51800da resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
95992024-12-06T20:54:48.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1739 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8cc123d6-b6d0-464b-b76f-0cdea51800da response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96002024-12-06T20:54:49.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eae938f5-8d53-4ee8-851a-560a3a5351bd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96012024-12-06T20:54:49.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eae938f5-8d53-4ee8-851a-560a3a5351bd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96022024-12-06T20:54:49.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eae938f5-8d53-4ee8-851a-560a3a5351bd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96032024-12-06T20:54:51.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f5723a5f-c14e-4cf6-a82e-0bcaeac0a605 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96042024-12-06T20:54:51.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f5723a5f-c14e-4cf6-a82e-0bcaeac0a605 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96052024-12-06T20:54:51.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f5723a5f-c14e-4cf6-a82e-0bcaeac0a605 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96062024-12-06T20:54:52.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6683240a-2cf0-48be-b9f1-dbac28eaceea roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96072024-12-06T20:54:52.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6683240a-2cf0-48be-b9f1-dbac28eaceea resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96082024-12-06T20:54:52.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6683240a-2cf0-48be-b9f1-dbac28eaceea response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96092024-12-06T20:54:52.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 434 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 4fb67397-43a5-4a1d-bdcb-7a4cb3909cbc response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
96102024-12-06T20:54:53.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f24dc6e8-01d7-4ae3-8322-f5e2a1999840 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96112024-12-06T20:54:53.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f24dc6e8-01d7-4ae3-8322-f5e2a1999840 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96122024-12-06T20:54:53.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f24dc6e8-01d7-4ae3-8322-f5e2a1999840 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96132024-12-06T20:54:54.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dd66a166-7196-4c5e-ba87-cb56d398aebf roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96142024-12-06T20:54:54.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dd66a166-7196-4c5e-ba87-cb56d398aebf resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96152024-12-06T20:54:54.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dd66a166-7196-4c5e-ba87-cb56d398aebf response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96162024-12-06T20:54:55.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e994c21-26f7-44b2-bb18-ef1946a0fb0d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96172024-12-06T20:54:55.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e994c21-26f7-44b2-bb18-ef1946a0fb0d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96182024-12-06T20:54:55.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e994c21-26f7-44b2-bb18-ef1946a0fb0d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96192024-12-06T20:54:56.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c66b4705-89a0-4f62-bbb7-cd65c640e544 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96202024-12-06T20:54:56.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c66b4705-89a0-4f62-bbb7-cd65c640e544 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96212024-12-06T20:54:56.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c66b4705-89a0-4f62-bbb7-cd65c640e544 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96222024-12-06T20:54:57.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2673a390-a36c-455d-8bba-6421192ca700 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96232024-12-06T20:54:57.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2673a390-a36c-455d-8bba-6421192ca700 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96242024-12-06T20:54:57.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2673a390-a36c-455d-8bba-6421192ca700 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96252024-12-06T20:54:57.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 7be652d8-39b8-48bf-af2f-45a8341a1988 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
96262024-12-06T20:54:57.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 7be652d8-39b8-48bf-af2f-45a8341a1988 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
96272024-12-06T20:54:57.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 7be652d8-39b8-48bf-af2f-45a8341a1988 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
96282024-12-06T20:54:57.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 39843d03-942d-414c-8e01-9aa4382e5434 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
96292024-12-06T20:54:57.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 39843d03-942d-414c-8e01-9aa4382e5434 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
96302024-12-06T20:54:57.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 39843d03-942d-414c-8e01-9aa4382e5434 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
96312024-12-06T20:54:58.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f7af0495-83cc-43e2-9074-b9be6d277c09 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96322024-12-06T20:54:58.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f7af0495-83cc-43e2-9074-b9be6d277c09 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96332024-12-06T20:54:58.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f7af0495-83cc-43e2-9074-b9be6d277c09 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
96342024-12-06T20:54:58.851ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
96352024-12-06T20:54:58.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96362024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96372024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
96382024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
96392024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96402024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
96412024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96422024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96432024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
96442024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
96452024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96462024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96472024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
96482024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
96492024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96502024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96512024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
96522024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96532024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
96542024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
96552024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
96562024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96572024-12-06T20:54:58.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
96582024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96592024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96602024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
96612024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96622024-12-06T20:54:58.853ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96632024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96642024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
96652024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96662024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
96672024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
96682024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96692024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96702024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96712024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96722024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96732024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96742024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96752024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96762024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96772024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96782024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96792024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96802024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96812024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96822024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96832024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96842024-12-06T20:54:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96852024-12-06T20:54:58.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6829, tv_nsec: 195042577 } })
96862024-12-06T20:54:58.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
96872024-12-06T20:54:58.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96882024-12-06T20:54:58.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96892024-12-06T20:54:58.856ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.972583ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96902024-12-06T20:54:58.858ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6829, tv_nsec: 198680201 } })
96912024-12-06T20:54:58.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96922024-12-06T20:54:58.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96932024-12-06T20:54:58.858ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
96942024-12-06T20:54:58.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96952024-12-06T20:54:58.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96962024-12-06T20:54:58.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96972024-12-06T20:54:58.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96982024-12-06T20:54:58.862ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96992024-12-06T20:54:58.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97002024-12-06T20:54:58.865ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97012024-12-06T20:54:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97022024-12-06T20:54:58.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97032024-12-06T20:54:58.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97042024-12-06T20:54:58.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97052024-12-06T20:54:58.869ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97062024-12-06T20:54:58.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97072024-12-06T20:54:58.873ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6829, tv_nsec: 213331339 } })
97082024-12-06T20:54:58.873ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
97092024-12-06T20:54:58.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97102024-12-06T20:54:58.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97112024-12-06T20:54:58.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97122024-12-06T20:54:58.879ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97132024-12-06T20:54:58.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97142024-12-06T20:54:58.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97152024-12-06T20:54:58.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
97162024-12-06T20:54:58.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97172024-12-06T20:54:58.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97182024-12-06T20:54:58.906ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97192024-12-06T20:54:58.906ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97202024-12-06T20:54:58.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97212024-12-06T20:54:58.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97222024-12-06T20:54:58.908ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97232024-12-06T20:54:58.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97242024-12-06T20:54:58.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97252024-12-06T20:54:58.909ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
97262024-12-06T20:54:58.909ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.298442ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
97272024-12-06T20:54:58.911ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97282024-12-06T20:54:58.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97292024-12-06T20:54:58.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97302024-12-06T20:54:58.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97312024-12-06T20:54:58.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97322024-12-06T20:54:58.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97332024-12-06T20:54:58.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97342024-12-06T20:54:58.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97352024-12-06T20:54:58.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97362024-12-06T20:54:58.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97372024-12-06T20:54:58.918ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97382024-12-06T20:54:58.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97392024-12-06T20:54:58.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97402024-12-06T20:54:58.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97412024-12-06T20:54:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97422024-12-06T20:54:58.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97432024-12-06T20:54:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97442024-12-06T20:54:58.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97452024-12-06T20:54:58.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.783003ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97462024-12-06T20:54:58.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.001009ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97472024-12-06T20:54:58.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.627861ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
97482024-12-06T20:54:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
97492024-12-06T20:54:58.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97502024-12-06T20:54:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97512024-12-06T20:54:58.926ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 73.614188ms iteration = 22 status = 0
97522024-12-06T20:54:58.932ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97532024-12-06T20:54:58.932ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97542024-12-06T20:54:58.932ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0785828-520e-4b64-9dc1-35dfedb55927", "content-length": "26", "date": "Fri, 06 Dec 2024 20:54:58 GMT"} })
97552024-12-06T20:54:58.932ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97562024-12-06T20:54:58.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 80.149446ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
97572024-12-06T20:54:58.934ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97582024-12-06T20:54:58.935ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97592024-12-06T20:54:58.936ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97602024-12-06T20:54:58.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97612024-12-06T20:54:58.937ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97622024-12-06T20:54:58.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97632024-12-06T20:54:58.939ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97642024-12-06T20:54:58.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97652024-12-06T20:54:58.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97662024-12-06T20:54:58.939ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97672024-12-06T20:54:58.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97682024-12-06T20:54:58.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.191383ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
97692024-12-06T20:54:58.944ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.089875ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
97702024-12-06T20:54:58.954ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97712024-12-06T20:54:58.954ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97722024-12-06T20:54:58.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97732024-12-06T20:54:58.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97742024-12-06T20:54:58.970ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
97752024-12-06T20:54:58.971ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97762024-12-06T20:54:58.971ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fba1f21-b101-46b0-89e5-fe8780295888", "content-length": "26", "date": "Fri, 06 Dec 2024 20:54:58 GMT"} })
97772024-12-06T20:54:58.971ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97782024-12-06T20:54:58.973ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
97792024-12-06T20:54:58.982ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97802024-12-06T20:54:58.982ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 129.663673ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97812024-12-06T20:54:58.996ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97822024-12-06T20:54:58.996ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
97832024-12-06T20:54:58.996ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.318315ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
97842024-12-06T20:54:59.008ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97852024-12-06T20:54:59.009ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97862024-12-06T20:54:59.009ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8716ca97-bbc0-4f8b-8424-0e6bf89419c0", "content-length": "26", "date": "Fri, 06 Dec 2024 20:54:58 GMT"} })
97872024-12-06T20:54:59.009ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97882024-12-06T20:54:59.011ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97892024-12-06T20:54:59.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97902024-12-06T20:54:59.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97912024-12-06T20:54:59.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97922024-12-06T20:54:59.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97932024-12-06T20:54:59.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97942024-12-06T20:54:59.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97952024-12-06T20:54:59.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97962024-12-06T20:54:59.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97972024-12-06T20:54:59.050ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97982024-12-06T20:54:59.053ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97992024-12-06T20:54:59.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98002024-12-06T20:54:59.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98012024-12-06T20:54:59.071ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 218.185515ms iteration = 25 status = {"physical_disks_added":0}
98022024-12-06T20:54:59.073ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98032024-12-06T20:54:59.073ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c319ac7e-b815-4f5d-ad8c-98fc88f29140", "content-length": "1", "date": "Fri, 06 Dec 2024 20:54:58 GMT"} })
98042024-12-06T20:54:59.074ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98052024-12-06T20:54:59.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98062024-12-06T20:54:59.122ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 269.666542ms iteration = 22 status = {}
98072024-12-06T20:54:59.122ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98082024-12-06T20:54:59.122ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98092024-12-06T20:54:59.123ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "10ade34d-6465-4f04-b6a9-696ed10eadc8", "content-length": "372", "date": "Fri, 06 Dec 2024 20:54:59 GMT"} })
98102024-12-06T20:54:59.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98112024-12-06T20:54:59.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98122024-12-06T20:54:59.126ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 274.342202ms iteration = 22 status = null
98132024-12-06T20:54:59.140ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
98142024-12-06T20:54:59.140ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98152024-12-06T20:54:59.141ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f639ac20-6122-4559-b932-8c487d3807ed", "date": "Fri, 06 Dec 2024 20:54:59 GMT"} })
98162024-12-06T20:54:59.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98172024-12-06T20:54:59.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98182024-12-06T20:54:59.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98192024-12-06T20:54:59.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98202024-12-06T20:54:59.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98212024-12-06T20:54:59.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98222024-12-06T20:54:59.151ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98232024-12-06T20:54:59.151ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98242024-12-06T20:54:59.152ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ebfe99a5-62f8-4e3a-b4c6-f88005329e2a", "date": "Fri, 06 Dec 2024 20:54:59 GMT"} })
98252024-12-06T20:54:59.154ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 301.365609ms iteration = 22 status = {}
98262024-12-06T20:54:59.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a9d284cd-f06e-49dc-9ab5-5c2941aacba1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98272024-12-06T20:54:59.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a9d284cd-f06e-49dc-9ab5-5c2941aacba1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98282024-12-06T20:54:59.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a9d284cd-f06e-49dc-9ab5-5c2941aacba1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98292024-12-06T20:54:59.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98302024-12-06T20:54:59.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98312024-12-06T20:54:59.191ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
98322024-12-06T20:54:59.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98332024-12-06T20:54:59.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98342024-12-06T20:54:59.204ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
98352024-12-06T20:54:59.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8dabac9-2536-4796-8a16-711115c78d10", "content-length": "134", "date": "Fri, 06 Dec 2024 20:54:58 GMT"} })
98362024-12-06T20:54:59.204ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
98372024-12-06T20:54:59.204ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
98382024-12-06T20:54:59.205ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
98392024-12-06T20:54:59.205ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
98402024-12-06T20:54:59.205ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98412024-12-06T20:54:59.205ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98422024-12-06T20:54:59.205ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98432024-12-06T20:54:59.205ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98442024-12-06T20:54:59.205ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
98452024-12-06T20:54:59.205ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
98462024-12-06T20:54:59.205ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
98472024-12-06T20:54:59.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98482024-12-06T20:54:59.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98492024-12-06T20:54:59.208ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
98502024-12-06T20:54:59.208ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e89875e-0c5f-43b2-9d75-b4aa839667c1", "content-length": "2", "date": "Fri, 06 Dec 2024 20:54:58 GMT"} })
98512024-12-06T20:54:59.208ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
98522024-12-06T20:54:59.208ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb509b54-635a-4ff8-89b0-3e1d4f9ff880", "content-length": "52", "date": "Fri, 06 Dec 2024 20:54:59 GMT"} })
98532024-12-06T20:54:59.208ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
98542024-12-06T20:54:59.208ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
98552024-12-06T20:54:59.233ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98562024-12-06T20:54:59.234ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "efb0e39e-2ed6-4a28-82f4-49c58be4f28c", "content-length": "691", "date": "Fri, 06 Dec 2024 20:54:59 GMT"} })
98572024-12-06T20:54:59.234ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
98582024-12-06T20:54:59.234ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
98592024-12-06T20:54:59.234ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
98602024-12-06T20:54:59.235ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 382.797689ms iteration = 22 status = {}
98612024-12-06T20:54:59.301ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "772bab28-32f4-42fa-a8ce-a3b92627b426", "date": "Fri, 06 Dec 2024 20:54:59 GMT"} })
98622024-12-06T20:54:59.301ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
98632024-12-06T20:54:59.301ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
98642024-12-06T20:54:59.305ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6999d81-0a33-4920-8079-03f420cf299d", "content-length": "682", "date": "Fri, 06 Dec 2024 20:54:59 GMT"} })
98652024-12-06T20:54:59.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98662024-12-06T20:54:59.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98672024-12-06T20:54:59.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98682024-12-06T20:54:59.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98692024-12-06T20:54:59.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98702024-12-06T20:54:59.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98712024-12-06T20:54:59.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98722024-12-06T20:54:59.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98732024-12-06T20:54:59.321ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 468.1957ms iteration = 22 status = {}
98742024-12-06T20:55:00.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 27ecd017-3ccd-4b43-8467-fdb260a9e6fd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98752024-12-06T20:55:00.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 27ecd017-3ccd-4b43-8467-fdb260a9e6fd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98762024-12-06T20:55:00.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 27ecd017-3ccd-4b43-8467-fdb260a9e6fd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98772024-12-06T20:55:01.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3008f40c-1776-4f50-aa05-82c3c5202e0e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98782024-12-06T20:55:01.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3008f40c-1776-4f50-aa05-82c3c5202e0e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98792024-12-06T20:55:01.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3008f40c-1776-4f50-aa05-82c3c5202e0e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98802024-12-06T20:55:02.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 33e56ef0-2c42-4704-aa74-3296a96f27c4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98812024-12-06T20:55:02.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 33e56ef0-2c42-4704-aa74-3296a96f27c4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98822024-12-06T20:55:02.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 33e56ef0-2c42-4704-aa74-3296a96f27c4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98832024-12-06T20:55:02.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 612eb29e-6b12-4ce3-92d3-3be9dd1e545a response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
98842024-12-06T20:55:03.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 380dbdcd-c286-41de-a85c-a321e429a72d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98852024-12-06T20:55:03.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 380dbdcd-c286-41de-a85c-a321e429a72d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98862024-12-06T20:55:03.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 380dbdcd-c286-41de-a85c-a321e429a72d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98872024-12-06T20:55:04.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8a829272-6864-47b8-ad40-9e0b370c8bb7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98882024-12-06T20:55:04.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8a829272-6864-47b8-ad40-9e0b370c8bb7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98892024-12-06T20:55:04.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8a829272-6864-47b8-ad40-9e0b370c8bb7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98902024-12-06T20:55:05.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b47e5c8e-c5eb-45d0-b6ac-54226698a999 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98912024-12-06T20:55:05.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b47e5c8e-c5eb-45d0-b6ac-54226698a999 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98922024-12-06T20:55:05.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b47e5c8e-c5eb-45d0-b6ac-54226698a999 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98932024-12-06T20:55:06.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8b63cef-8389-4840-937c-6d7976069799 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98942024-12-06T20:55:06.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8b63cef-8389-4840-937c-6d7976069799 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98952024-12-06T20:55:06.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f8b63cef-8389-4840-937c-6d7976069799 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98962024-12-06T20:55:07.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 48ff784f-5cc2-4d7f-9c57-e41d9173475d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98972024-12-06T20:55:07.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 48ff784f-5cc2-4d7f-9c57-e41d9173475d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98982024-12-06T20:55:07.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 48ff784f-5cc2-4d7f-9c57-e41d9173475d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
98992024-12-06T20:55:08.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a17b5aa3-3d49-49c1-98e0-494dbf92d62c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99002024-12-06T20:55:08.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a17b5aa3-3d49-49c1-98e0-494dbf92d62c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99012024-12-06T20:55:08.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a17b5aa3-3d49-49c1-98e0-494dbf92d62c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99022024-12-06T20:55:08.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
99032024-12-06T20:55:08.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
99042024-12-06T20:55:08.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99052024-12-06T20:55:08.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99062024-12-06T20:55:08.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99072024-12-06T20:55:08.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99082024-12-06T20:55:08.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99092024-12-06T20:55:08.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99102024-12-06T20:55:08.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99112024-12-06T20:55:08.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99122024-12-06T20:55:08.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99132024-12-06T20:55:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99142024-12-06T20:55:08.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99152024-12-06T20:55:08.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
99162024-12-06T20:55:08.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99172024-12-06T20:55:08.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99182024-12-06T20:55:08.872ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
99192024-12-06T20:55:08.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.645756ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
99202024-12-06T20:55:08.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99212024-12-06T20:55:08.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99222024-12-06T20:55:08.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.221138ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99232024-12-06T20:55:09.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = afe974ca-8138-44a4-8d6b-27127ce323a2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99242024-12-06T20:55:09.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = afe974ca-8138-44a4-8d6b-27127ce323a2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99252024-12-06T20:55:09.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = afe974ca-8138-44a4-8d6b-27127ce323a2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99262024-12-06T20:55:10.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2bef477d-4cb7-45fa-b718-1ca663cd7b8c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99272024-12-06T20:55:10.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2bef477d-4cb7-45fa-b718-1ca663cd7b8c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99282024-12-06T20:55:10.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2bef477d-4cb7-45fa-b718-1ca663cd7b8c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99292024-12-06T20:55:11.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d491152e-5f8b-430f-aa4f-a5976e136193 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99302024-12-06T20:55:11.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d491152e-5f8b-430f-aa4f-a5976e136193 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99312024-12-06T20:55:11.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d491152e-5f8b-430f-aa4f-a5976e136193 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99322024-12-06T20:55:12.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 421 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = e208c870-98b8-4f58-8175-d5066ba2a26d response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
99332024-12-06T20:55:12.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c2b3943-d2ec-4648-9255-ec23e6908b5f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99342024-12-06T20:55:12.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c2b3943-d2ec-4648-9255-ec23e6908b5f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99352024-12-06T20:55:12.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0c2b3943-d2ec-4648-9255-ec23e6908b5f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99362024-12-06T20:55:13.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13656549-5647-460b-8528-f2bdd5b2fee8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99372024-12-06T20:55:13.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13656549-5647-460b-8528-f2bdd5b2fee8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99382024-12-06T20:55:13.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13656549-5647-460b-8528-f2bdd5b2fee8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99392024-12-06T20:55:14.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 489d05c6-8807-4daf-ae04-71db1f5926d8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99402024-12-06T20:55:14.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 489d05c6-8807-4daf-ae04-71db1f5926d8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99412024-12-06T20:55:14.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 489d05c6-8807-4daf-ae04-71db1f5926d8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99422024-12-06T20:55:15.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b8f0d4b-694f-4392-9229-f94895d0f08c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99432024-12-06T20:55:15.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b8f0d4b-694f-4392-9229-f94895d0f08c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99442024-12-06T20:55:15.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b8f0d4b-694f-4392-9229-f94895d0f08c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99452024-12-06T20:55:16.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1fa82569-3f09-4cd2-9e53-dda284262e35 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99462024-12-06T20:55:16.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1fa82569-3f09-4cd2-9e53-dda284262e35 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99472024-12-06T20:55:16.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1fa82569-3f09-4cd2-9e53-dda284262e35 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99482024-12-06T20:55:17.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 32f15175-b3aa-4142-ab3b-71055384e6e6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99492024-12-06T20:55:17.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 32f15175-b3aa-4142-ab3b-71055384e6e6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99502024-12-06T20:55:17.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 32f15175-b3aa-4142-ab3b-71055384e6e6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99512024-12-06T20:55:18.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d8cfc792-bc52-41b3-83f7-ebf7516f3d0f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99522024-12-06T20:55:18.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d8cfc792-bc52-41b3-83f7-ebf7516f3d0f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99532024-12-06T20:55:18.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d8cfc792-bc52-41b3-83f7-ebf7516f3d0f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99542024-12-06T20:55:18.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
99552024-12-06T20:55:18.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
99562024-12-06T20:55:18.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99572024-12-06T20:55:18.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99582024-12-06T20:55:18.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99592024-12-06T20:55:18.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99602024-12-06T20:55:18.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99612024-12-06T20:55:18.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99622024-12-06T20:55:18.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99632024-12-06T20:55:18.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.918671ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99642024-12-06T20:55:18.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99652024-12-06T20:55:18.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99662024-12-06T20:55:18.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99672024-12-06T20:55:18.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99682024-12-06T20:55:18.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99692024-12-06T20:55:18.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99702024-12-06T20:55:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
99712024-12-06T20:55:18.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99722024-12-06T20:55:18.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99732024-12-06T20:55:18.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
99742024-12-06T20:55:18.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.197005ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
99752024-12-06T20:55:19.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2bde4c02-26a4-47a1-99da-e868604b356c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99762024-12-06T20:55:19.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2bde4c02-26a4-47a1-99da-e868604b356c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99772024-12-06T20:55:19.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2bde4c02-26a4-47a1-99da-e868604b356c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99782024-12-06T20:55:20.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eeda8a8e-a82d-4012-8066-578ba29d8ee2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99792024-12-06T20:55:20.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eeda8a8e-a82d-4012-8066-578ba29d8ee2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99802024-12-06T20:55:20.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = eeda8a8e-a82d-4012-8066-578ba29d8ee2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99812024-12-06T20:55:21.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 419382d8-ec34-4a39-880c-bfdd2ca8be74 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99822024-12-06T20:55:21.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 419382d8-ec34-4a39-880c-bfdd2ca8be74 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99832024-12-06T20:55:21.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 419382d8-ec34-4a39-880c-bfdd2ca8be74 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99842024-12-06T20:55:22.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 492 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 32d1d2dc-e2a5-41c3-aa83-6fb8405a0210 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
99852024-12-06T20:55:22.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7f459a0f-dbe8-4e01-991e-880e7b25bf5d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99862024-12-06T20:55:22.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7f459a0f-dbe8-4e01-991e-880e7b25bf5d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99872024-12-06T20:55:22.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7f459a0f-dbe8-4e01-991e-880e7b25bf5d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99882024-12-06T20:55:23.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 17e83dd8-d663-4d37-93a0-cb013f8ffb21 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99892024-12-06T20:55:23.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 17e83dd8-d663-4d37-93a0-cb013f8ffb21 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99902024-12-06T20:55:23.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 17e83dd8-d663-4d37-93a0-cb013f8ffb21 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99912024-12-06T20:55:24.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d99dfff-4d6d-405a-bb83-22a5d4139f98 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99922024-12-06T20:55:24.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d99dfff-4d6d-405a-bb83-22a5d4139f98 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99932024-12-06T20:55:24.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d99dfff-4d6d-405a-bb83-22a5d4139f98 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99942024-12-06T20:55:25.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1ee6512e-0aab-4699-b20a-0e2238008cf9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99952024-12-06T20:55:25.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1ee6512e-0aab-4699-b20a-0e2238008cf9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99962024-12-06T20:55:25.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1ee6512e-0aab-4699-b20a-0e2238008cf9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99972024-12-06T20:55:26.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5149db38-2ec5-4033-9266-d456a24fa080 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99982024-12-06T20:55:26.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5149db38-2ec5-4033-9266-d456a24fa080 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
99992024-12-06T20:55:26.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5149db38-2ec5-4033-9266-d456a24fa080 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
100002024-12-06T20:55:27.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 6b34b81e-dd09-486b-9d3b-313fcca1db05 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
100012024-12-06T20:55:27.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 6b34b81e-dd09-486b-9d3b-313fcca1db05 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
100022024-12-06T20:55:27.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 6b34b81e-dd09-486b-9d3b-313fcca1db05 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
100032024-12-06T20:55:27.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 4a27531c-df6e-4d4f-9395-c528ea662d32 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
100042024-12-06T20:55:27.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 4a27531c-df6e-4d4f-9395-c528ea662d32 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
100052024-12-06T20:55:27.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 4a27531c-df6e-4d4f-9395-c528ea662d32 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
100062024-12-06T20:55:27.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = faff481a-5359-419f-8b40-4eefb1bae160 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
100072024-12-06T20:55:27.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = faff481a-5359-419f-8b40-4eefb1bae160 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
100082024-12-06T20:55:27.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = faff481a-5359-419f-8b40-4eefb1bae160 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
100092024-12-06T20:55:28.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d1c0bac3-f160-4c28-b05c-7e73c2e8365d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
100102024-12-06T20:55:28.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d1c0bac3-f160-4c28-b05c-7e73c2e8365d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
100112024-12-06T20:55:28.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d1c0bac3-f160-4c28-b05c-7e73c2e8365d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
100122024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
100132024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
100142024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100152024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
100162024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
100172024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100182024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
100192024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
100202024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100212024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
100222024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
100232024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
100242024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100252024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
100262024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
100272024-12-06T20:55:28.852ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:45:28.852172037 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
100282024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
100292024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
100302024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
100312024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100322024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100332024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
100342024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
100352024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
100362024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100372024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
100382024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
100392024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100402024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100412024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100422024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
100432024-12-06T20:55:28.852ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100442024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100452024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
100462024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100472024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
100482024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
100492024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
100502024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
100512024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
100522024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100532024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100542024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
100552024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
100562024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100572024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
100582024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100592024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100602024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
100612024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100622024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
100632024-12-06T20:55:28.852ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
100642024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
100652024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
100662024-12-06T20:55:28.852ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
100672024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.071\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
100682024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
100692024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
100702024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
100712024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100722024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
100732024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100742024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100752024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100762024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100772024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
100782024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100792024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100802024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100812024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100822024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100832024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
100842024-12-06T20:55:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100852024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100862024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100872024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100882024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100892024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
100902024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100912024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100922024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100932024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100942024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100952024-12-06T20:55:28.853ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6859, tv_nsec: 193749664 } })
100962024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100972024-12-06T20:55:28.853ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6859, tv_nsec: 193903408 } })
100982024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100992024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
101002024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
101012024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.478198ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
101022024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
101032024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.748235ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
101042024-12-06T20:55:28.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101052024-12-06T20:55:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101062024-12-06T20:55:28.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101072024-12-06T20:55:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101082024-12-06T20:55:28.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101092024-12-06T20:55:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.800408ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101102024-12-06T20:55:28.856ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:45:28.852172037 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
101112024-12-06T20:55:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.380953ms iteration = 12 status = {"expiration":"2024-12-06T20:45:28.852172037Z","pruned":[]}
101122024-12-06T20:55:28.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101132024-12-06T20:55:28.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101142024-12-06T20:55:28.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
101152024-12-06T20:55:28.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101162024-12-06T20:55:28.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101172024-12-06T20:55:28.859ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101182024-12-06T20:55:28.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101192024-12-06T20:55:28.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101202024-12-06T20:55:28.860ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.894653ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
101212024-12-06T20:55:28.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101222024-12-06T20:55:28.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101232024-12-06T20:55:28.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101242024-12-06T20:55:28.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101252024-12-06T20:55:28.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101262024-12-06T20:55:28.866ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6859, tv_nsec: 206869552 } })
101272024-12-06T20:55:28.866ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
101282024-12-06T20:55:28.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101292024-12-06T20:55:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101302024-12-06T20:55:28.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6859, tv_nsec: 208886184 } })
101312024-12-06T20:55:28.868ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
101322024-12-06T20:55:28.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101332024-12-06T20:55:28.869ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101342024-12-06T20:55:28.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101352024-12-06T20:55:28.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101362024-12-06T20:55:28.871ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101372024-12-06T20:55:28.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101382024-12-06T20:55:28.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101392024-12-06T20:55:28.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101402024-12-06T20:55:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101412024-12-06T20:55:28.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101422024-12-06T20:55:28.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101432024-12-06T20:55:28.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101442024-12-06T20:55:28.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101452024-12-06T20:55:28.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.895734ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101462024-12-06T20:55:28.879ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101472024-12-06T20:55:28.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101482024-12-06T20:55:28.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
101492024-12-06T20:55:28.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101502024-12-06T20:55:28.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101512024-12-06T20:55:28.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 32.928989ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101522024-12-06T20:55:28.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101532024-12-06T20:55:28.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101542024-12-06T20:55:28.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101552024-12-06T20:55:28.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101562024-12-06T20:55:28.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101572024-12-06T20:55:28.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
101582024-12-06T20:55:28.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101592024-12-06T20:55:28.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101602024-12-06T20:55:28.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101612024-12-06T20:55:28.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101622024-12-06T20:55:28.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101632024-12-06T20:55:28.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101642024-12-06T20:55:28.931ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101652024-12-06T20:55:28.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101662024-12-06T20:55:28.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101672024-12-06T20:55:28.935ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101682024-12-06T20:55:28.937ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 85.178746ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
101692024-12-06T20:55:28.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101702024-12-06T20:55:28.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101712024-12-06T20:55:28.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101722024-12-06T20:55:28.938ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 85.757391ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
101732024-12-06T20:55:28.939ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
101742024-12-06T20:55:28.939ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
101752024-12-06T20:55:28.939ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 86.913621ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
101762024-12-06T20:55:28.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
101772024-12-06T20:55:28.939ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101782024-12-06T20:55:28.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
101792024-12-06T20:55:28.940ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101802024-12-06T20:55:28.941ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101812024-12-06T20:55:28.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101822024-12-06T20:55:28.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101832024-12-06T20:55:28.941ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
101842024-12-06T20:55:28.941ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.517688ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
101852024-12-06T20:55:28.943ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6859, tv_nsec: 284421621 } })
101862024-12-06T20:55:28.944ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101872024-12-06T20:55:28.944ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101882024-12-06T20:55:28.944ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101892024-12-06T20:55:28.944ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
101902024-12-06T20:55:28.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101912024-12-06T20:55:28.945ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101922024-12-06T20:55:28.945ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 93.216814ms iteration = 26 status = {"physical_disks_added":0}
101932024-12-06T20:55:28.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101942024-12-06T20:55:28.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101952024-12-06T20:55:28.947ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101962024-12-06T20:55:28.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101972024-12-06T20:55:28.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101982024-12-06T20:55:28.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101992024-12-06T20:55:28.949ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
102002024-12-06T20:55:28.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102012024-12-06T20:55:28.949ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
102022024-12-06T20:55:28.949ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
102032024-12-06T20:55:28.949ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
102042024-12-06T20:55:28.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102052024-12-06T20:55:28.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102062024-12-06T20:55:28.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102072024-12-06T20:55:28.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102082024-12-06T20:55:28.952ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102092024-12-06T20:55:28.952ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 99.879955ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
102102024-12-06T20:55:28.952ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102112024-12-06T20:55:28.952ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102122024-12-06T20:55:28.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102132024-12-06T20:55:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102142024-12-06T20:55:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102152024-12-06T20:55:28.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102162024-12-06T20:55:28.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102172024-12-06T20:55:28.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
102182024-12-06T20:55:28.957ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102192024-12-06T20:55:28.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102202024-12-06T20:55:28.959ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
102212024-12-06T20:55:28.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102222024-12-06T20:55:28.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102232024-12-06T20:55:28.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102242024-12-06T20:55:28.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
102252024-12-06T20:55:28.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102262024-12-06T20:55:28.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102272024-12-06T20:55:28.974ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.620796ms iteration = 23 status = 0
102282024-12-06T20:55:28.985ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102292024-12-06T20:55:28.985ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102302024-12-06T20:55:28.986ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a553018-c1ca-4d79-8b0f-5c73e1c17ff6", "content-length": "26", "date": "Fri, 06 Dec 2024 20:55:28 GMT"} })
102312024-12-06T20:55:28.986ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102322024-12-06T20:55:28.987ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 135.341919ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
102332024-12-06T20:55:28.989ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102342024-12-06T20:55:28.994ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
102352024-12-06T20:55:28.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102362024-12-06T20:55:29.001ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
102372024-12-06T20:55:29.001ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
102382024-12-06T20:55:29.001ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 149.403281ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
102392024-12-06T20:55:29.006ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102402024-12-06T20:55:29.006ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102412024-12-06T20:55:29.006ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 154.521134ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102422024-12-06T20:55:29.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 157.969972ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
102432024-12-06T20:55:29.011ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
102442024-12-06T20:55:29.011ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
102452024-12-06T20:55:29.011ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
102462024-12-06T20:55:29.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102472024-12-06T20:55:29.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102482024-12-06T20:55:29.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102492024-12-06T20:55:29.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102502024-12-06T20:55:29.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102512024-12-06T20:55:29.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102522024-12-06T20:55:29.020ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
102532024-12-06T20:55:29.020ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
102542024-12-06T20:55:29.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102552024-12-06T20:55:29.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102562024-12-06T20:55:29.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102572024-12-06T20:55:29.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102582024-12-06T20:55:29.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102592024-12-06T20:55:29.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102602024-12-06T20:55:29.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102612024-12-06T20:55:29.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102622024-12-06T20:55:29.032ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
102632024-12-06T20:55:29.032ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
102642024-12-06T20:55:29.032ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
102652024-12-06T20:55:29.032ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 180.407671ms iteration = 12 status = {"generation":2}
102662024-12-06T20:55:29.034ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102672024-12-06T20:55:29.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102682024-12-06T20:55:29.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102692024-12-06T20:55:29.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102702024-12-06T20:55:29.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102712024-12-06T20:55:29.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102722024-12-06T20:55:29.070ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
102732024-12-06T20:55:29.070ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
102742024-12-06T20:55:29.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102752024-12-06T20:55:29.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102762024-12-06T20:55:29.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102772024-12-06T20:55:29.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102782024-12-06T20:55:29.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102792024-12-06T20:55:29.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102802024-12-06T20:55:29.081ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
102812024-12-06T20:55:29.081ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
102822024-12-06T20:55:29.081ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
102832024-12-06T20:55:29.081ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 229.806794ms iteration = 12 status = {"generation":1}
102842024-12-06T20:55:29.090ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) }
102852024-12-06T20:55:29.090ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 238.57808ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
102862024-12-06T20:55:29.100ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
102872024-12-06T20:55:29.100ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 247.807028ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
102882024-12-06T20:55:29.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102892024-12-06T20:55:29.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102902024-12-06T20:55:29.116ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102912024-12-06T20:55:29.116ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102922024-12-06T20:55:29.116ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "491436ac-d679-44ba-929d-9469981fb624", "content-length": "26", "date": "Fri, 06 Dec 2024 20:55:28 GMT"} })
102932024-12-06T20:55:29.116ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102942024-12-06T20:55:29.118ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102952024-12-06T20:55:29.142ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102962024-12-06T20:55:29.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102972024-12-06T20:55:29.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102982024-12-06T20:55:29.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102992024-12-06T20:55:29.146ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103002024-12-06T20:55:29.149ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103012024-12-06T20:55:29.149ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103022024-12-06T20:55:29.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103032024-12-06T20:55:29.175ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103042024-12-06T20:55:29.175ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "59a4ec0a-412c-46a3-97a7-ceb589d7cff2", "content-length": "1", "date": "Fri, 06 Dec 2024 20:55:28 GMT"} })
103052024-12-06T20:55:29.177ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
103062024-12-06T20:55:29.178ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103072024-12-06T20:55:29.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103082024-12-06T20:55:29.181ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 328.984441ms iteration = 23 status = null
103092024-12-06T20:55:29.249ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103102024-12-06T20:55:29.249ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103112024-12-06T20:55:29.249ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bda601a-071d-4697-bc31-b3e4a7b44e26", "content-length": "372", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} })
103122024-12-06T20:55:29.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103132024-12-06T20:55:29.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103142024-12-06T20:55:29.252ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
103152024-12-06T20:55:29.252ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103162024-12-06T20:55:29.252ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d2d00fc-4892-441b-9f4f-49a7f91359ae", "content-length": "26", "date": "Fri, 06 Dec 2024 20:55:28 GMT"} })
103172024-12-06T20:55:29.252ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103182024-12-06T20:55:29.254ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
103192024-12-06T20:55:29.254ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
103202024-12-06T20:55:29.254ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "076e9157-1794-4ecf-99ff-74ee00c1201f", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103212024-12-06T20:55:29.254ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103222024-12-06T20:55:29.256ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4d88e337-df8d-4bf9-aed6-3b72f2cd3280", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103232024-12-06T20:55:29.256ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103242024-12-06T20:55:29.259ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103252024-12-06T20:55:29.259ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 407.065144ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
103262024-12-06T20:55:29.308ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
103272024-12-06T20:55:29.308ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5de89d68-c2db-4032-8f65-303ecc0ebc9d", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103282024-12-06T20:55:29.308ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103292024-12-06T20:55:29.311ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "054cea0f-cdc9-4870-99b2-83c862e4df87", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103302024-12-06T20:55:29.311ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103312024-12-06T20:55:29.313ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4bfcb845-09a7-4af8-8623-79ebf5d3ccd4", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103322024-12-06T20:55:29.313ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103332024-12-06T20:55:29.315ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103342024-12-06T20:55:29.316ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 463.93222ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
103352024-12-06T20:55:29.316ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
103362024-12-06T20:55:29.316ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103372024-12-06T20:55:29.316ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7fa827ba-5b2c-4912-ae02-ba40b44491de", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} })
103382024-12-06T20:55:29.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103392024-12-06T20:55:29.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103402024-12-06T20:55:29.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103412024-12-06T20:55:29.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103422024-12-06T20:55:29.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103432024-12-06T20:55:29.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103442024-12-06T20:55:29.328ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103452024-12-06T20:55:29.328ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103462024-12-06T20:55:29.328ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0114785c-4631-415d-9f55-d8703274aa84", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} })
103472024-12-06T20:55:29.330ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 478.121076ms iteration = 23 status = {}
103482024-12-06T20:55:29.335ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103492024-12-06T20:55:29.335ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca3cac4e-c304-4612-ac90-8941a24bb036", "content-length": "691", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} })
103502024-12-06T20:55:29.335ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
103512024-12-06T20:55:29.335ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
103522024-12-06T20:55:29.335ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
103532024-12-06T20:55:29.337ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 484.801769ms iteration = 23 status = {}
103542024-12-06T20:55:29.343ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 490.970318ms iteration = 23 status = {}
103552024-12-06T20:55:29.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103562024-12-06T20:55:29.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103572024-12-06T20:55:29.435ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
103582024-12-06T20:55:29.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103592024-12-06T20:55:29.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103602024-12-06T20:55:29.444ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103612024-12-06T20:55:29.444ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "908a9753-bc5d-49f1-a258-8634c4d4ac2d", "content-length": "134", "date": "Fri, 06 Dec 2024 20:55:28 GMT"} })
103622024-12-06T20:55:29.444ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103632024-12-06T20:55:29.444ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
103642024-12-06T20:55:29.444ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103652024-12-06T20:55:29.444ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103662024-12-06T20:55:29.444ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103672024-12-06T20:55:29.444ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103682024-12-06T20:55:29.444ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103692024-12-06T20:55:29.444ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103702024-12-06T20:55:29.445ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103712024-12-06T20:55:29.445ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103722024-12-06T20:55:29.445ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
103732024-12-06T20:55:29.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103742024-12-06T20:55:29.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103752024-12-06T20:55:29.447ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103762024-12-06T20:55:29.447ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "469507bc-d327-4169-a48a-c8ecc3fc9680", "content-length": "2", "date": "Fri, 06 Dec 2024 20:55:28 GMT"} })
103772024-12-06T20:55:29.447ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103782024-12-06T20:55:29.448ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d95aefbb-3dda-4708-9955-9fb246d2a000", "content-length": "52", "date": "Fri, 06 Dec 2024 20:55:28 GMT"} })
103792024-12-06T20:55:29.448ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
103802024-12-06T20:55:29.448ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103812024-12-06T20:55:29.543ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cbf81758-d139-4024-9d19-13882080e141", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} })
103822024-12-06T20:55:29.543ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
103832024-12-06T20:55:29.543ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103842024-12-06T20:55:29.544ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "72dce35c-12a0-4363-82fe-5f3419b00c4a", "content-length": "682", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} })
103852024-12-06T20:55:29.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103862024-12-06T20:55:29.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103872024-12-06T20:55:29.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103882024-12-06T20:55:29.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103892024-12-06T20:55:29.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103902024-12-06T20:55:29.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103912024-12-06T20:55:29.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103922024-12-06T20:55:29.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103932024-12-06T20:55:29.560ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 708.557276ms iteration = 23 status = {}
103942024-12-06T20:55:29.573ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
103952024-12-06T20:55:29.573ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
103962024-12-06T20:55:29.604ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
103972024-12-06T20:55:29.604ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:59247
103982024-12-06T20:55:29.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59247 req_id = 99a853b0-f232-4a9a-8a41-9b1f77632f6a roles = RoleSet { roles: {} } uri = /metrics/producers
103992024-12-06T20:55:29.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59247 req_id = 99a853b0-f232-4a9a-8a41-9b1f77632f6a resource = Database result = Ok(()) uri = /metrics/producers
104002024-12-06T20:55:29.644ZINFOnexus: assigned collector to new producer collector_id = bef145b4-2934-45c3-870a-63d45572bde4 file = nexus/src/app/oximeter.rs:76 producer_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
104012024-12-06T20:55:29.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40610 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59247 req_id = 99a853b0-f232-4a9a-8a41-9b1f77632f6a response_code = 201 uri = /metrics/producers
104022024-12-06T20:55:29.645ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "99a853b0-f232-4a9a-8a41-9b1f77632f6a", "content-length": "41", "date": "Fri, 06 Dec 2024 20:55:29 GMT"} })
104032024-12-06T20:55:29.647ZDEBGnexus (producer-registration-task): registered with nexus successfully
104042024-12-06T20:55:29.647ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
104052024-12-06T20:55:29.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 44c581dc-73af-4857-babb-356229d9f23d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104062024-12-06T20:55:29.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 44c581dc-73af-4857-babb-356229d9f23d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104072024-12-06T20:55:29.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 44c581dc-73af-4857-babb-356229d9f23d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104082024-12-06T20:55:30.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 23b1f2a0-c159-4cf0-947f-befc71317dc8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104092024-12-06T20:55:30.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 23b1f2a0-c159-4cf0-947f-befc71317dc8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104102024-12-06T20:55:30.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 23b1f2a0-c159-4cf0-947f-befc71317dc8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104112024-12-06T20:55:31.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cd95c613-fc61-4c15-8c07-4ab3a04b268c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104122024-12-06T20:55:31.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cd95c613-fc61-4c15-8c07-4ab3a04b268c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104132024-12-06T20:55:31.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cd95c613-fc61-4c15-8c07-4ab3a04b268c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104142024-12-06T20:55:32.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = e312e59c-84b1-49b8-a4b7-69451284574a response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
104152024-12-06T20:55:32.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3e3cb2ac-2502-47f3-a79b-9f179809e3ab roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104162024-12-06T20:55:32.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3e3cb2ac-2502-47f3-a79b-9f179809e3ab resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104172024-12-06T20:55:32.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3e3cb2ac-2502-47f3-a79b-9f179809e3ab response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104182024-12-06T20:55:33.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2951b5c8-57b3-4189-a108-02cea958b40f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104192024-12-06T20:55:33.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2951b5c8-57b3-4189-a108-02cea958b40f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104202024-12-06T20:55:33.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2951b5c8-57b3-4189-a108-02cea958b40f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104212024-12-06T20:55:34.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7aa45de2-4b5e-446d-9a9e-28f21bf586cf roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104222024-12-06T20:55:34.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7aa45de2-4b5e-446d-9a9e-28f21bf586cf resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104232024-12-06T20:55:34.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7aa45de2-4b5e-446d-9a9e-28f21bf586cf response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104242024-12-06T20:55:35.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f4e09aba-6d06-4ad5-b79d-5c6831f19288 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104252024-12-06T20:55:35.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f4e09aba-6d06-4ad5-b79d-5c6831f19288 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104262024-12-06T20:55:35.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f4e09aba-6d06-4ad5-b79d-5c6831f19288 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104272024-12-06T20:55:36.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c4f08388-0a32-4753-abc4-d4359555380c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104282024-12-06T20:55:36.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c4f08388-0a32-4753-abc4-d4359555380c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104292024-12-06T20:55:36.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c4f08388-0a32-4753-abc4-d4359555380c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104302024-12-06T20:55:37.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 45e0f75b-46bd-4286-8078-35f6046e479e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104312024-12-06T20:55:37.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 45e0f75b-46bd-4286-8078-35f6046e479e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104322024-12-06T20:55:38.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 45e0f75b-46bd-4286-8078-35f6046e479e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104332024-12-06T20:55:38.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
104342024-12-06T20:55:38.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
104352024-12-06T20:55:38.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104362024-12-06T20:55:38.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104372024-12-06T20:55:38.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104382024-12-06T20:55:38.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104392024-12-06T20:55:38.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104402024-12-06T20:55:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104412024-12-06T20:55:38.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104422024-12-06T20:55:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104432024-12-06T20:55:38.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104442024-12-06T20:55:38.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104452024-12-06T20:55:38.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104462024-12-06T20:55:38.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
104472024-12-06T20:55:38.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104482024-12-06T20:55:38.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104492024-12-06T20:55:38.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
104502024-12-06T20:55:38.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.997163ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
104512024-12-06T20:55:38.881ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104522024-12-06T20:55:38.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104532024-12-06T20:55:38.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.954183ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104542024-12-06T20:55:39.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 309bb92b-ec13-4d95-955b-ed241ffd970a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104552024-12-06T20:55:39.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 309bb92b-ec13-4d95-955b-ed241ffd970a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104562024-12-06T20:55:39.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 309bb92b-ec13-4d95-955b-ed241ffd970a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104572024-12-06T20:55:40.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9129708e-10fd-4885-bdc2-e773b8f7be30 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104582024-12-06T20:55:40.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9129708e-10fd-4885-bdc2-e773b8f7be30 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104592024-12-06T20:55:40.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9129708e-10fd-4885-bdc2-e773b8f7be30 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104602024-12-06T20:55:41.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = acfdb7a2-7d15-4b73-9b5c-70115bf6997c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104612024-12-06T20:55:41.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = acfdb7a2-7d15-4b73-9b5c-70115bf6997c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104622024-12-06T20:55:41.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = acfdb7a2-7d15-4b73-9b5c-70115bf6997c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104632024-12-06T20:55:42.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5481b314-1515-432d-95f3-932e63e5b8fd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104642024-12-06T20:55:42.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5481b314-1515-432d-95f3-932e63e5b8fd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104652024-12-06T20:55:42.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5481b314-1515-432d-95f3-932e63e5b8fd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104662024-12-06T20:55:42.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 48e91203-b679-49b8-96dc-3ba205328d56 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
104672024-12-06T20:55:42.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 48e91203-b679-49b8-96dc-3ba205328d56 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
104682024-12-06T20:55:42.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 48e91203-b679-49b8-96dc-3ba205328d56 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
104692024-12-06T20:55:42.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 84a41b3c-c7af-4f1d-81a0-1fca75177dd5 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
104702024-12-06T20:55:42.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 84a41b3c-c7af-4f1d-81a0-1fca75177dd5 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
104712024-12-06T20:55:42.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 84a41b3c-c7af-4f1d-81a0-1fca75177dd5 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
104722024-12-06T20:55:42.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 407 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = c7d6a69c-8295-4191-ad2e-3908c961ae29 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
104732024-12-06T20:55:43.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce99e79c-a897-4b08-965f-55586a301346 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104742024-12-06T20:55:43.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce99e79c-a897-4b08-965f-55586a301346 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104752024-12-06T20:55:43.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce99e79c-a897-4b08-965f-55586a301346 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104762024-12-06T20:55:44.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 191aa4c4-69ce-4236-b52b-046ead748563 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104772024-12-06T20:55:44.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 191aa4c4-69ce-4236-b52b-046ead748563 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104782024-12-06T20:55:44.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 191aa4c4-69ce-4236-b52b-046ead748563 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104792024-12-06T20:55:45.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11b7d0d5-4995-4012-80fb-a5b8a5fa755b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104802024-12-06T20:55:45.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11b7d0d5-4995-4012-80fb-a5b8a5fa755b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104812024-12-06T20:55:45.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 11b7d0d5-4995-4012-80fb-a5b8a5fa755b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104822024-12-06T20:55:46.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = effb1c5e-f5f6-4bb8-bf46-e4571f7f66bb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104832024-12-06T20:55:46.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = effb1c5e-f5f6-4bb8-bf46-e4571f7f66bb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104842024-12-06T20:55:46.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = effb1c5e-f5f6-4bb8-bf46-e4571f7f66bb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104852024-12-06T20:55:47.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cbdd550f-201f-4fd4-a543-b6e5ccb8130c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104862024-12-06T20:55:47.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cbdd550f-201f-4fd4-a543-b6e5ccb8130c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104872024-12-06T20:55:47.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cbdd550f-201f-4fd4-a543-b6e5ccb8130c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104882024-12-06T20:55:48.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dd6c74b0-e221-485c-a7aa-7f556975a05d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104892024-12-06T20:55:48.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dd6c74b0-e221-485c-a7aa-7f556975a05d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104902024-12-06T20:55:48.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dd6c74b0-e221-485c-a7aa-7f556975a05d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
104912024-12-06T20:55:48.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
104922024-12-06T20:55:48.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
104932024-12-06T20:55:48.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104942024-12-06T20:55:48.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104952024-12-06T20:55:48.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104962024-12-06T20:55:48.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104972024-12-06T20:55:48.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104982024-12-06T20:55:48.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104992024-12-06T20:55:48.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105002024-12-06T20:55:48.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.696086ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105012024-12-06T20:55:48.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105022024-12-06T20:55:48.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105032024-12-06T20:55:48.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105042024-12-06T20:55:48.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105052024-12-06T20:55:48.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105062024-12-06T20:55:48.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105072024-12-06T20:55:48.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
105082024-12-06T20:55:48.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105092024-12-06T20:55:48.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105102024-12-06T20:55:48.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
105112024-12-06T20:55:48.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.231379ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
105122024-12-06T20:55:49.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d68ec1ce-4a5c-41dd-ae7a-7c9b311f1763 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105132024-12-06T20:55:49.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d68ec1ce-4a5c-41dd-ae7a-7c9b311f1763 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105142024-12-06T20:55:49.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d68ec1ce-4a5c-41dd-ae7a-7c9b311f1763 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105152024-12-06T20:55:50.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 331e14b2-f645-4efd-9237-48aeea4cd558 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105162024-12-06T20:55:50.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 331e14b2-f645-4efd-9237-48aeea4cd558 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105172024-12-06T20:55:50.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 331e14b2-f645-4efd-9237-48aeea4cd558 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105182024-12-06T20:55:51.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9543e59d-36bc-45b0-9a0a-069020adc095 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105192024-12-06T20:55:51.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9543e59d-36bc-45b0-9a0a-069020adc095 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105202024-12-06T20:55:51.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9543e59d-36bc-45b0-9a0a-069020adc095 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105212024-12-06T20:55:52.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 26abcce3-453a-40a2-a4e1-1405927f0e4c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105222024-12-06T20:55:52.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 26abcce3-453a-40a2-a4e1-1405927f0e4c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105232024-12-06T20:55:52.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 26abcce3-453a-40a2-a4e1-1405927f0e4c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105242024-12-06T20:55:52.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 762 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = de8afca0-65d4-4783-b7ba-272f24075007 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
105252024-12-06T20:55:53.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e83cf799-b17c-40ef-b340-1884540b73d4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105262024-12-06T20:55:53.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e83cf799-b17c-40ef-b340-1884540b73d4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105272024-12-06T20:55:53.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e83cf799-b17c-40ef-b340-1884540b73d4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105282024-12-06T20:55:54.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3c4033f1-f7c9-4be0-a340-ee96586e133e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105292024-12-06T20:55:54.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3c4033f1-f7c9-4be0-a340-ee96586e133e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105302024-12-06T20:55:54.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3c4033f1-f7c9-4be0-a340-ee96586e133e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105312024-12-06T20:55:55.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 38f2114b-18b0-447d-9329-3e4d3ffe1077 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105322024-12-06T20:55:55.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 38f2114b-18b0-447d-9329-3e4d3ffe1077 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105332024-12-06T20:55:55.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 38f2114b-18b0-447d-9329-3e4d3ffe1077 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105342024-12-06T20:55:56.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab6d99c8-2956-4abd-9a23-6b0da37fbb38 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105352024-12-06T20:55:56.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab6d99c8-2956-4abd-9a23-6b0da37fbb38 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105362024-12-06T20:55:56.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab6d99c8-2956-4abd-9a23-6b0da37fbb38 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105372024-12-06T20:55:57.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a4a7069e-f32b-482a-b8db-c08361c5bf5e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105382024-12-06T20:55:57.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a4a7069e-f32b-482a-b8db-c08361c5bf5e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105392024-12-06T20:55:57.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a4a7069e-f32b-482a-b8db-c08361c5bf5e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105402024-12-06T20:55:58.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 32da69af-5bd6-4c30-9719-7edc682fdb06 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105412024-12-06T20:55:58.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 32da69af-5bd6-4c30-9719-7edc682fdb06 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105422024-12-06T20:55:58.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 32da69af-5bd6-4c30-9719-7edc682fdb06 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
105432024-12-06T20:55:58.851ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
105442024-12-06T20:55:58.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105452024-12-06T20:55:58.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105462024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
105472024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105482024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
105492024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
105502024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105512024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105522024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
105532024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
105542024-12-06T20:55:58.852ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105552024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105562024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105572024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
105582024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
105592024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105602024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105612024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105622024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
105632024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
105642024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105652024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
105662024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105672024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
105682024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105692024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
105702024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
105712024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105722024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105732024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105742024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
105752024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105762024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
105772024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
105782024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105792024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105802024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105812024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105822024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105832024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105842024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105852024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105862024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105872024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105882024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105892024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105902024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105912024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105922024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105932024-12-06T20:55:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105942024-12-06T20:55:58.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6889, tv_nsec: 195443687 } })
105952024-12-06T20:55:58.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105962024-12-06T20:55:58.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
105972024-12-06T20:55:58.855ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105982024-12-06T20:55:58.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105992024-12-06T20:55:58.856ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.285041ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
106002024-12-06T20:55:58.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106012024-12-06T20:55:58.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106022024-12-06T20:55:58.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106032024-12-06T20:55:58.858ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106042024-12-06T20:55:58.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106052024-12-06T20:55:58.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106062024-12-06T20:55:58.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106072024-12-06T20:55:58.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106082024-12-06T20:55:58.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106092024-12-06T20:55:58.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.506145ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
106102024-12-06T20:55:58.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106112024-12-06T20:55:58.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106122024-12-06T20:55:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106132024-12-06T20:55:58.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106142024-12-06T20:55:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106152024-12-06T20:55:58.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106162024-12-06T20:55:58.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106172024-12-06T20:55:58.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106182024-12-06T20:55:58.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106192024-12-06T20:55:58.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6889, tv_nsec: 211874570 } })
106202024-12-06T20:55:58.871ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
106212024-12-06T20:55:58.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106222024-12-06T20:55:58.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106232024-12-06T20:55:58.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106242024-12-06T20:55:58.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106252024-12-06T20:55:58.872ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106262024-12-06T20:55:58.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106272024-12-06T20:55:58.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106282024-12-06T20:55:58.881ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
106292024-12-06T20:55:58.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 29.330036ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
106302024-12-06T20:55:58.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106312024-12-06T20:55:58.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106322024-12-06T20:55:58.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106332024-12-06T20:55:58.889ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106342024-12-06T20:55:58.889ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6889, tv_nsec: 230075519 } })
106352024-12-06T20:55:58.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106362024-12-06T20:55:58.889ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106372024-12-06T20:55:58.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106382024-12-06T20:55:58.889ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
106392024-12-06T20:55:58.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
106402024-12-06T20:55:58.893ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106412024-12-06T20:55:58.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106422024-12-06T20:55:58.903ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106432024-12-06T20:55:58.903ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106442024-12-06T20:55:58.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106452024-12-06T20:55:58.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106462024-12-06T20:55:58.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.697311ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
106472024-12-06T20:55:58.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.595526ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
106482024-12-06T20:55:58.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
106492024-12-06T20:55:58.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.318509ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
106502024-12-06T20:55:58.920ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106512024-12-06T20:55:58.920ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
106522024-12-06T20:55:58.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106532024-12-06T20:55:58.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106542024-12-06T20:55:58.922ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106552024-12-06T20:55:58.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106562024-12-06T20:55:58.922ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106572024-12-06T20:55:58.922ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106582024-12-06T20:55:58.922ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106592024-12-06T20:55:58.922ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106602024-12-06T20:55:58.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106612024-12-06T20:55:58.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106622024-12-06T20:55:58.924ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.939345ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106632024-12-06T20:55:58.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106642024-12-06T20:55:58.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106652024-12-06T20:55:58.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106662024-12-06T20:55:58.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106672024-12-06T20:55:58.929ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106682024-12-06T20:55:58.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106692024-12-06T20:55:58.932ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106702024-12-06T20:55:58.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106712024-12-06T20:55:58.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106722024-12-06T20:55:58.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
106732024-12-06T20:55:58.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106742024-12-06T20:55:58.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106752024-12-06T20:55:58.943ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 91.500748ms iteration = 27 status = {"physical_disks_added":0}
106762024-12-06T20:55:58.943ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106772024-12-06T20:55:58.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106782024-12-06T20:55:58.953ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106792024-12-06T20:55:58.953ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
106802024-12-06T20:55:58.953ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.270381ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
106812024-12-06T20:55:58.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.009382ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106822024-12-06T20:55:58.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106832024-12-06T20:55:58.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106842024-12-06T20:55:59.030ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106852024-12-06T20:55:59.030ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106862024-12-06T20:55:59.030ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65e364fb-0c93-4b2b-b675-ea07b1860f5f", "content-length": "26", "date": "Fri, 06 Dec 2024 20:55:58 GMT"} })
106872024-12-06T20:55:59.030ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106882024-12-06T20:55:59.032ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106892024-12-06T20:55:59.058ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
106902024-12-06T20:55:59.058ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106912024-12-06T20:55:59.059ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4013f87c-3e91-4563-b4fb-c0da607cc8cc", "content-length": "372", "date": "Fri, 06 Dec 2024 20:55:59 GMT"} })
106922024-12-06T20:55:59.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106932024-12-06T20:55:59.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106942024-12-06T20:55:59.060ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 208.625289ms iteration = 24 status = 0
106952024-12-06T20:55:59.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 241.096716ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
106962024-12-06T20:55:59.106ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
106972024-12-06T20:55:59.106ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
106982024-12-06T20:55:59.106ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c94d56d8-99d8-405d-badc-28eca15dd38a", "date": "Fri, 06 Dec 2024 20:55:59 GMT"} })
106992024-12-06T20:55:59.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107002024-12-06T20:55:59.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107012024-12-06T20:55:59.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107022024-12-06T20:55:59.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107032024-12-06T20:55:59.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107042024-12-06T20:55:59.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107052024-12-06T20:55:59.115ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107062024-12-06T20:55:59.115ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107072024-12-06T20:55:59.115ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "69fb7f96-9bd8-4da9-8b87-4f33d40d32d5", "date": "Fri, 06 Dec 2024 20:55:59 GMT"} })
107082024-12-06T20:55:59.117ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 265.051614ms iteration = 24 status = {}
107092024-12-06T20:55:59.120ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
107102024-12-06T20:55:59.120ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107112024-12-06T20:55:59.120ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "623cada0-f59f-415d-a17a-7c8da241ffdd", "content-length": "26", "date": "Fri, 06 Dec 2024 20:55:58 GMT"} })
107122024-12-06T20:55:59.120ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107132024-12-06T20:55:59.122ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107142024-12-06T20:55:59.126ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
107152024-12-06T20:55:59.126ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107162024-12-06T20:55:59.126ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea057e4b-7f80-4ed4-a06c-0981712e9a71", "content-length": "26", "date": "Fri, 06 Dec 2024 20:55:58 GMT"} })
107172024-12-06T20:55:59.126ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107182024-12-06T20:55:59.129ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
107192024-12-06T20:55:59.129ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
107202024-12-06T20:55:59.129ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "975d198b-d493-4958-b9c0-7dbffd668f8d", "content-length": "1", "date": "Fri, 06 Dec 2024 20:55:58 GMT"} })
107212024-12-06T20:55:59.130ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
107222024-12-06T20:55:59.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107232024-12-06T20:55:59.132ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 280.956363ms iteration = 24 status = null
107242024-12-06T20:55:59.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107252024-12-06T20:55:59.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107262024-12-06T20:55:59.156ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107272024-12-06T20:55:59.159ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107282024-12-06T20:55:59.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107292024-12-06T20:55:59.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107302024-12-06T20:55:59.182ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 330.032228ms iteration = 24 status = {}
107312024-12-06T20:55:59.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107322024-12-06T20:55:59.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107332024-12-06T20:55:59.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107342024-12-06T20:55:59.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107352024-12-06T20:55:59.327ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
107362024-12-06T20:55:59.328ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "10865f57-8ed4-4a65-b771-1272ea29bdff", "content-length": "691", "date": "Fri, 06 Dec 2024 20:55:59 GMT"} })
107372024-12-06T20:55:59.328ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
107382024-12-06T20:55:59.328ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
107392024-12-06T20:55:59.328ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
107402024-12-06T20:55:59.329ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 477.607352ms iteration = 24 status = {}
107412024-12-06T20:55:59.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107422024-12-06T20:55:59.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107432024-12-06T20:55:59.353ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
107442024-12-06T20:55:59.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107452024-12-06T20:55:59.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107462024-12-06T20:55:59.363ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
107472024-12-06T20:55:59.363ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6907c9c-21f7-4410-bb73-794b577bdf4e", "content-length": "134", "date": "Fri, 06 Dec 2024 20:55:58 GMT"} })
107482024-12-06T20:55:59.363ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
107492024-12-06T20:55:59.363ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
107502024-12-06T20:55:59.363ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
107512024-12-06T20:55:59.363ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
107522024-12-06T20:55:59.363ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107532024-12-06T20:55:59.363ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107542024-12-06T20:55:59.363ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107552024-12-06T20:55:59.363ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107562024-12-06T20:55:59.364ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107572024-12-06T20:55:59.364ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107582024-12-06T20:55:59.364ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
107592024-12-06T20:55:59.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107602024-12-06T20:55:59.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107612024-12-06T20:55:59.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
107622024-12-06T20:55:59.366ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bb32d9e-fe2b-4bff-a4fa-a75a5ea3ae10", "content-length": "2", "date": "Fri, 06 Dec 2024 20:55:58 GMT"} })
107632024-12-06T20:55:59.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
107642024-12-06T20:55:59.366ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a63fc3c-63a6-441c-8b6d-6accaedbc287", "content-length": "52", "date": "Fri, 06 Dec 2024 20:55:58 GMT"} })
107652024-12-06T20:55:59.366ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
107662024-12-06T20:55:59.366ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
107672024-12-06T20:55:59.456ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e872d2a0-15c0-4915-b459-b9c8db4a5f28", "date": "Fri, 06 Dec 2024 20:55:59 GMT"} })
107682024-12-06T20:55:59.456ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
107692024-12-06T20:55:59.456ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
107702024-12-06T20:55:59.456ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a69a7c3-60f5-4c64-a4a3-169ffa630a04", "content-length": "682", "date": "Fri, 06 Dec 2024 20:55:59 GMT"} })
107712024-12-06T20:55:59.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107722024-12-06T20:55:59.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107732024-12-06T20:55:59.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea5147a4-682c-4b26-85f6-cacf54316573 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107742024-12-06T20:55:59.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea5147a4-682c-4b26-85f6-cacf54316573 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107752024-12-06T20:55:59.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea5147a4-682c-4b26-85f6-cacf54316573 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107762024-12-06T20:55:59.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107772024-12-06T20:55:59.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107782024-12-06T20:55:59.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107792024-12-06T20:55:59.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107802024-12-06T20:55:59.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107812024-12-06T20:55:59.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107822024-12-06T20:55:59.472ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 620.744743ms iteration = 24 status = {}
107832024-12-06T20:56:00.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d15eeec0-73d4-44b6-94b6-d4c38eedadb6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107842024-12-06T20:56:00.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d15eeec0-73d4-44b6-94b6-d4c38eedadb6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107852024-12-06T20:56:00.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2760 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d15eeec0-73d4-44b6-94b6-d4c38eedadb6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107862024-12-06T20:56:01.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = df1f8245-7a39-4088-bce0-4f92c4a20278 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107872024-12-06T20:56:01.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = df1f8245-7a39-4088-bce0-4f92c4a20278 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107882024-12-06T20:56:01.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = df1f8245-7a39-4088-bce0-4f92c4a20278 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107892024-12-06T20:56:02.413ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 533 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 86b34c5a-51a7-4252-9ca5-f93777f9225f response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
107902024-12-06T20:56:02.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4a941a96-f2d0-4619-b930-120bfe6ee857 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107912024-12-06T20:56:02.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4a941a96-f2d0-4619-b930-120bfe6ee857 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107922024-12-06T20:56:02.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4a941a96-f2d0-4619-b930-120bfe6ee857 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107932024-12-06T20:56:03.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cb090261-fe8c-4843-8f38-0a12bf466c3c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107942024-12-06T20:56:03.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cb090261-fe8c-4843-8f38-0a12bf466c3c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107952024-12-06T20:56:03.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cb090261-fe8c-4843-8f38-0a12bf466c3c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107962024-12-06T20:56:04.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a8fbbdf-d21d-49f1-bf6a-b21afc8f14bb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107972024-12-06T20:56:04.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a8fbbdf-d21d-49f1-bf6a-b21afc8f14bb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107982024-12-06T20:56:04.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2a8fbbdf-d21d-49f1-bf6a-b21afc8f14bb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
107992024-12-06T20:56:05.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c5851d2f-0e24-439c-9752-961325555ef5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108002024-12-06T20:56:05.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c5851d2f-0e24-439c-9752-961325555ef5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108012024-12-06T20:56:05.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c5851d2f-0e24-439c-9752-961325555ef5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108022024-12-06T20:56:06.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bec9c41c-60e0-46a3-b536-105c3fd47063 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108032024-12-06T20:56:06.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bec9c41c-60e0-46a3-b536-105c3fd47063 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108042024-12-06T20:56:06.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bec9c41c-60e0-46a3-b536-105c3fd47063 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108052024-12-06T20:56:07.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b0cddacc-943a-478e-8826-808d6e396069 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108062024-12-06T20:56:07.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b0cddacc-943a-478e-8826-808d6e396069 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108072024-12-06T20:56:07.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b0cddacc-943a-478e-8826-808d6e396069 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108082024-12-06T20:56:08.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = df6277ac-b8d0-4c73-8d3f-fffb4632e4bb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108092024-12-06T20:56:08.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = df6277ac-b8d0-4c73-8d3f-fffb4632e4bb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108102024-12-06T20:56:08.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = df6277ac-b8d0-4c73-8d3f-fffb4632e4bb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108112024-12-06T20:56:08.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
108122024-12-06T20:56:08.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
108132024-12-06T20:56:08.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108142024-12-06T20:56:08.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108152024-12-06T20:56:08.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108162024-12-06T20:56:08.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108172024-12-06T20:56:08.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108182024-12-06T20:56:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108192024-12-06T20:56:08.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108202024-12-06T20:56:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108212024-12-06T20:56:08.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108222024-12-06T20:56:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108232024-12-06T20:56:08.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108242024-12-06T20:56:08.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
108252024-12-06T20:56:08.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108262024-12-06T20:56:08.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108272024-12-06T20:56:08.880ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
108282024-12-06T20:56:08.880ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.007762ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
108292024-12-06T20:56:08.883ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108302024-12-06T20:56:08.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108312024-12-06T20:56:08.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.681809ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108322024-12-06T20:56:09.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 94e4b857-c569-4ce8-baa4-719fbff10123 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108332024-12-06T20:56:09.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 94e4b857-c569-4ce8-baa4-719fbff10123 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108342024-12-06T20:56:09.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 94e4b857-c569-4ce8-baa4-719fbff10123 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108352024-12-06T20:56:10.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7caaf8cb-9008-4289-8228-0d3b809f7649 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108362024-12-06T20:56:10.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7caaf8cb-9008-4289-8228-0d3b809f7649 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108372024-12-06T20:56:10.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7caaf8cb-9008-4289-8228-0d3b809f7649 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108382024-12-06T20:56:11.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4cee5509-bc4d-4d71-94d6-22cda91037ea roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108392024-12-06T20:56:11.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4cee5509-bc4d-4d71-94d6-22cda91037ea resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108402024-12-06T20:56:11.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4cee5509-bc4d-4d71-94d6-22cda91037ea response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108412024-12-06T20:56:12.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 444 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = a6f98328-6339-41a2-8856-53bd5111479d response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
108422024-12-06T20:56:12.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = afb781f4-a513-412e-b480-556109f9cdde roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108432024-12-06T20:56:12.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = afb781f4-a513-412e-b480-556109f9cdde resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108442024-12-06T20:56:12.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = afb781f4-a513-412e-b480-556109f9cdde response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108452024-12-06T20:56:13.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = edf33eca-9e6d-4cc0-b372-4b629fa17cc1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108462024-12-06T20:56:13.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = edf33eca-9e6d-4cc0-b372-4b629fa17cc1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108472024-12-06T20:56:13.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = edf33eca-9e6d-4cc0-b372-4b629fa17cc1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108482024-12-06T20:56:14.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 651dfd0b-d455-47a7-a642-0a06e1acd7d4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108492024-12-06T20:56:14.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 651dfd0b-d455-47a7-a642-0a06e1acd7d4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108502024-12-06T20:56:14.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 651dfd0b-d455-47a7-a642-0a06e1acd7d4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108512024-12-06T20:56:15.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0dc4542a-61c0-4cc8-b6cd-0245e32307c4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108522024-12-06T20:56:15.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0dc4542a-61c0-4cc8-b6cd-0245e32307c4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108532024-12-06T20:56:15.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0dc4542a-61c0-4cc8-b6cd-0245e32307c4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108542024-12-06T20:56:16.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 92b6a146-50ea-4d66-b1d5-2914696ffd18 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108552024-12-06T20:56:16.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 92b6a146-50ea-4d66-b1d5-2914696ffd18 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108562024-12-06T20:56:16.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 92b6a146-50ea-4d66-b1d5-2914696ffd18 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108572024-12-06T20:56:17.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a119cc6d-b74c-47e5-b9c2-2280fbe3df03 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108582024-12-06T20:56:17.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a119cc6d-b74c-47e5-b9c2-2280fbe3df03 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108592024-12-06T20:56:17.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a119cc6d-b74c-47e5-b9c2-2280fbe3df03 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108602024-12-06T20:56:18.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
108612024-12-06T20:56:18.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
108622024-12-06T20:56:18.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108632024-12-06T20:56:18.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108642024-12-06T20:56:18.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108652024-12-06T20:56:18.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108662024-12-06T20:56:18.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108672024-12-06T20:56:18.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108682024-12-06T20:56:18.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108692024-12-06T20:56:18.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.023344ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108702024-12-06T20:56:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108712024-12-06T20:56:18.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108722024-12-06T20:56:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108732024-12-06T20:56:18.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108742024-12-06T20:56:18.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108752024-12-06T20:56:18.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108762024-12-06T20:56:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
108772024-12-06T20:56:18.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108782024-12-06T20:56:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108792024-12-06T20:56:18.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
108802024-12-06T20:56:18.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.932888ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
108812024-12-06T20:56:18.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cc69b53b-241b-4fd3-b87d-2ce957845c9e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108822024-12-06T20:56:18.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cc69b53b-241b-4fd3-b87d-2ce957845c9e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108832024-12-06T20:56:18.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = cc69b53b-241b-4fd3-b87d-2ce957845c9e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108842024-12-06T20:56:19.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 52cb88e5-67e2-4d63-8725-4129d3a6eb40 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108852024-12-06T20:56:19.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 52cb88e5-67e2-4d63-8725-4129d3a6eb40 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108862024-12-06T20:56:19.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 52cb88e5-67e2-4d63-8725-4129d3a6eb40 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108872024-12-06T20:56:20.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ed7b9a10-a194-4211-83d8-ddcda6dc71d2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108882024-12-06T20:56:20.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ed7b9a10-a194-4211-83d8-ddcda6dc71d2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108892024-12-06T20:56:20.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ed7b9a10-a194-4211-83d8-ddcda6dc71d2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108902024-12-06T20:56:21.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76aac17f-072f-4bfc-93a0-dc169ce26ede roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108912024-12-06T20:56:21.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76aac17f-072f-4bfc-93a0-dc169ce26ede resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108922024-12-06T20:56:21.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 76aac17f-072f-4bfc-93a0-dc169ce26ede response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108932024-12-06T20:56:22.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 465 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 5e26b9b9-066c-47e4-8404-b86210c898eb response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
108942024-12-06T20:56:22.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 73ad4839-9c55-4b9a-922f-8eca7a1e8dc8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108952024-12-06T20:56:22.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 73ad4839-9c55-4b9a-922f-8eca7a1e8dc8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108962024-12-06T20:56:22.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 73ad4839-9c55-4b9a-922f-8eca7a1e8dc8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108972024-12-06T20:56:23.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5ef602f5-da81-4367-8abd-7639c9959784 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108982024-12-06T20:56:23.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5ef602f5-da81-4367-8abd-7639c9959784 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
108992024-12-06T20:56:23.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5ef602f5-da81-4367-8abd-7639c9959784 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109002024-12-06T20:56:25.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 417efab5-c599-4db5-8fe3-d1b125285bfd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109012024-12-06T20:56:25.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 417efab5-c599-4db5-8fe3-d1b125285bfd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109022024-12-06T20:56:25.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 417efab5-c599-4db5-8fe3-d1b125285bfd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109032024-12-06T20:56:26.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 437dc85a-09f8-45ad-b745-a4c6b7d4d18b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109042024-12-06T20:56:26.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 437dc85a-09f8-45ad-b745-a4c6b7d4d18b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109052024-12-06T20:56:26.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 437dc85a-09f8-45ad-b745-a4c6b7d4d18b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109062024-12-06T20:56:27.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2cfd9833-67a7-4a95-a521-bca78b8af3fa roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109072024-12-06T20:56:27.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2cfd9833-67a7-4a95-a521-bca78b8af3fa resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109082024-12-06T20:56:27.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2cfd9833-67a7-4a95-a521-bca78b8af3fa response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109092024-12-06T20:56:28.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c93f53a3-627d-4a9e-80e5-5325b84edf3d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109102024-12-06T20:56:28.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c93f53a3-627d-4a9e-80e5-5325b84edf3d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109112024-12-06T20:56:28.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c93f53a3-627d-4a9e-80e5-5325b84edf3d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
109122024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
109132024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109142024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
109152024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
109162024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
109172024-12-06T20:56:28.851ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:46:28.851287524 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
109182024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109192024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
109202024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
109212024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
109222024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109232024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
109242024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
109252024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
109262024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
109272024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109282024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
109292024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109302024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109312024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
109322024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109332024-12-06T20:56:28.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109342024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
109352024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
109362024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
109372024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
109382024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
109392024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109402024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
109412024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109422024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
109432024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
109442024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109452024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109462024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
109472024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
109482024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
109492024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109502024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
109512024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109522024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
109532024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
109542024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
109552024-12-06T20:56:28.852ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
109562024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
109572024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109582024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109592024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
109602024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109612024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
109622024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
109632024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109642024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
109652024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109662024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
109672024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109682024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
109692024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
109702024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109712024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
109722024-12-06T20:56:28.852ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
109732024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
109742024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
109752024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
109762024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
109772024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
109782024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
109792024-12-06T20:56:28.852ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
109802024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.11\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
109812024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
109822024-12-06T20:56:28.852ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6919, tv_nsec: 193419154 } })
109832024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109842024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109852024-12-06T20:56:28.852ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6919, tv_nsec: 193453935 } })
109862024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
109872024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109882024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
109892024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109902024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
109912024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109922024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109932024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109942024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109952024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109962024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
109972024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109982024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109992024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110002024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110012024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
110022024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
110032024-12-06T20:56:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
110042024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
110052024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.695903ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
110062024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
110072024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.712734ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
110082024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110092024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110102024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110112024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110122024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110132024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110142024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110152024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110162024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110172024-12-06T20:56:28.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110182024-12-06T20:56:28.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110192024-12-06T20:56:28.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6919, tv_nsec: 195349914 } })
110202024-12-06T20:56:28.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
110212024-12-06T20:56:28.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110222024-12-06T20:56:28.855ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:46:28.851287524 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
110232024-12-06T20:56:28.855ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.936051ms iteration = 13 status = {"expiration":"2024-12-06T20:46:28.851287524Z","pruned":[]}
110242024-12-06T20:56:28.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
110252024-12-06T20:56:28.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110262024-12-06T20:56:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110272024-12-06T20:56:28.857ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.609274ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
110282024-12-06T20:56:28.858ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110292024-12-06T20:56:28.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110302024-12-06T20:56:28.859ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.252517ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
110312024-12-06T20:56:28.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6919, tv_nsec: 201777550 } })
110322024-12-06T20:56:28.861ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
110332024-12-06T20:56:28.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110342024-12-06T20:56:28.862ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110352024-12-06T20:56:28.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110362024-12-06T20:56:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
110372024-12-06T20:56:28.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110382024-12-06T20:56:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110392024-12-06T20:56:28.869ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110402024-12-06T20:56:28.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
110412024-12-06T20:56:28.872ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110422024-12-06T20:56:28.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
110432024-12-06T20:56:28.892ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110442024-12-06T20:56:28.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
110452024-12-06T20:56:28.895ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110462024-12-06T20:56:28.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110472024-12-06T20:56:28.905ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110482024-12-06T20:56:28.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
110492024-12-06T20:56:28.908ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110502024-12-06T20:56:28.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110512024-12-06T20:56:28.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110522024-12-06T20:56:28.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
110532024-12-06T20:56:28.920ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110542024-12-06T20:56:28.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110552024-12-06T20:56:28.925ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110562024-12-06T20:56:28.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110572024-12-06T20:56:28.926ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110582024-12-06T20:56:28.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.622735ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
110592024-12-06T20:56:28.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
110602024-12-06T20:56:28.929ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110612024-12-06T20:56:28.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110622024-12-06T20:56:28.930ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
110632024-12-06T20:56:28.930ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
110642024-12-06T20:56:28.930ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 78.551875ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
110652024-12-06T20:56:28.933ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6919, tv_nsec: 274961487 } })
110662024-12-06T20:56:28.934ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
110672024-12-06T20:56:28.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110682024-12-06T20:56:28.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110692024-12-06T20:56:28.937ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110702024-12-06T20:56:28.938ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110712024-12-06T20:56:28.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110722024-12-06T20:56:28.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110732024-12-06T20:56:28.939ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110742024-12-06T20:56:28.939ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
110752024-12-06T20:56:28.939ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110762024-12-06T20:56:28.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110772024-12-06T20:56:28.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
110782024-12-06T20:56:28.941ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110792024-12-06T20:56:28.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
110802024-12-06T20:56:28.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110812024-12-06T20:56:28.941ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110822024-12-06T20:56:28.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110832024-12-06T20:56:28.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110842024-12-06T20:56:28.942ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110852024-12-06T20:56:28.942ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110862024-12-06T20:56:28.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
110872024-12-06T20:56:28.946ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110882024-12-06T20:56:28.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110892024-12-06T20:56:28.946ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110902024-12-06T20:56:28.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110912024-12-06T20:56:28.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110922024-12-06T20:56:28.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110932024-12-06T20:56:28.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110942024-12-06T20:56:28.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110952024-12-06T20:56:28.949ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110962024-12-06T20:56:28.949ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
110972024-12-06T20:56:28.949ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
110982024-12-06T20:56:28.949ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
110992024-12-06T20:56:28.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111002024-12-06T20:56:28.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111012024-12-06T20:56:28.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111022024-12-06T20:56:28.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111032024-12-06T20:56:28.954ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111042024-12-06T20:56:28.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111052024-12-06T20:56:28.954ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 102.600665ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
111062024-12-06T20:56:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111072024-12-06T20:56:28.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111082024-12-06T20:56:28.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111092024-12-06T20:56:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
111102024-12-06T20:56:28.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111112024-12-06T20:56:28.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111122024-12-06T20:56:28.959ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111132024-12-06T20:56:28.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111142024-12-06T20:56:28.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111152024-12-06T20:56:28.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111162024-12-06T20:56:28.961ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111172024-12-06T20:56:28.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111182024-12-06T20:56:28.964ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111192024-12-06T20:56:28.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111202024-12-06T20:56:28.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
111212024-12-06T20:56:28.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111222024-12-06T20:56:28.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111232024-12-06T20:56:28.972ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111242024-12-06T20:56:28.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
111252024-12-06T20:56:28.976ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
111262024-12-06T20:56:28.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
111272024-12-06T20:56:28.980ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 128.653457ms iteration = 6 status = {"nsuccess":5}
111282024-12-06T20:56:28.990ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
111292024-12-06T20:56:28.990ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
111302024-12-06T20:56:28.990ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
111312024-12-06T20:56:28.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111322024-12-06T20:56:28.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111332024-12-06T20:56:28.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111342024-12-06T20:56:28.996ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 144.372492ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111352024-12-06T20:56:28.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111362024-12-06T20:56:28.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111372024-12-06T20:56:28.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111382024-12-06T20:56:29.004ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
111392024-12-06T20:56:29.004ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
111402024-12-06T20:56:29.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111412024-12-06T20:56:29.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111422024-12-06T20:56:29.005ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111432024-12-06T20:56:29.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111442024-12-06T20:56:29.007ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
111452024-12-06T20:56:29.007ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 155.714954ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
111462024-12-06T20:56:29.008ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111472024-12-06T20:56:29.012ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111482024-12-06T20:56:29.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111492024-12-06T20:56:29.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111502024-12-06T20:56:29.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111512024-12-06T20:56:29.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111522024-12-06T20:56:29.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111532024-12-06T20:56:29.016ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
111542024-12-06T20:56:29.016ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
111552024-12-06T20:56:29.016ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
111562024-12-06T20:56:29.016ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 165.664971ms iteration = 13 status = {"generation":1}
111572024-12-06T20:56:29.017ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
111582024-12-06T20:56:29.017ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 165.524448ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
111592024-12-06T20:56:29.017ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 165.701132ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111602024-12-06T20:56:29.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
111612024-12-06T20:56:29.018ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111622024-12-06T20:56:29.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
111632024-12-06T20:56:29.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111642024-12-06T20:56:29.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111652024-12-06T20:56:29.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111662024-12-06T20:56:29.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111672024-12-06T20:56:29.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111682024-12-06T20:56:29.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
111692024-12-06T20:56:29.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111702024-12-06T20:56:29.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111712024-12-06T20:56:29.026ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
111722024-12-06T20:56:29.026ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
111732024-12-06T20:56:29.026ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 174.15964ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
111742024-12-06T20:56:29.027ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 175.415003ms iteration = 25 status = 0
111752024-12-06T20:56:29.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111762024-12-06T20:56:29.030ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111772024-12-06T20:56:29.030ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
111782024-12-06T20:56:29.030ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111792024-12-06T20:56:29.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111802024-12-06T20:56:29.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111812024-12-06T20:56:29.031ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111822024-12-06T20:56:29.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111832024-12-06T20:56:29.033ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 180.831582ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
111842024-12-06T20:56:29.037ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
111852024-12-06T20:56:29.037ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111862024-12-06T20:56:29.037ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4786892c-30c1-4133-8729-07ff2e6ceaae", "content-length": "26", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} })
111872024-12-06T20:56:29.037ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111882024-12-06T20:56:29.041ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111892024-12-06T20:56:29.044ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
111902024-12-06T20:56:29.044ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111912024-12-06T20:56:29.044ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc84b775-f721-4164-8d44-74f098102e99", "content-length": "26", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} })
111922024-12-06T20:56:29.044ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111932024-12-06T20:56:29.047ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 194.814833ms iteration = 28 status = {"physical_disks_added":0}
111942024-12-06T20:56:29.048ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111952024-12-06T20:56:29.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111962024-12-06T20:56:29.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111972024-12-06T20:56:29.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111982024-12-06T20:56:29.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111992024-12-06T20:56:29.069ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 217.518857ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
112002024-12-06T20:56:29.070ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112012024-12-06T20:56:29.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
112022024-12-06T20:56:29.074ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112032024-12-06T20:56:29.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112042024-12-06T20:56:29.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112052024-12-06T20:56:29.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112062024-12-06T20:56:29.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112072024-12-06T20:56:29.086ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112082024-12-06T20:56:29.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112092024-12-06T20:56:29.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112102024-12-06T20:56:29.087ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
112112024-12-06T20:56:29.087ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
112122024-12-06T20:56:29.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112132024-12-06T20:56:29.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112142024-12-06T20:56:29.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112152024-12-06T20:56:29.090ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112162024-12-06T20:56:29.090ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
112172024-12-06T20:56:29.090ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 237.999505ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
112182024-12-06T20:56:29.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112192024-12-06T20:56:29.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112202024-12-06T20:56:29.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112212024-12-06T20:56:29.096ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
112222024-12-06T20:56:29.096ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
112232024-12-06T20:56:29.096ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
112242024-12-06T20:56:29.096ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 245.207202ms iteration = 13 status = {"generation":2}
112252024-12-06T20:56:29.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 069bbbea-37c1-4336-995c-ccd204fbc409 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
112262024-12-06T20:56:29.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 069bbbea-37c1-4336-995c-ccd204fbc409 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
112272024-12-06T20:56:29.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 069bbbea-37c1-4336-995c-ccd204fbc409 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
112282024-12-06T20:56:29.120ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
112292024-12-06T20:56:29.121ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112302024-12-06T20:56:29.121ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f1d4c62-17bc-48e4-965d-dd30c1878dfc", "content-length": "26", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} })
112312024-12-06T20:56:29.121ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112322024-12-06T20:56:29.124ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
112332024-12-06T20:56:29.129ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) }
112342024-12-06T20:56:29.129ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 278.370776ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
112352024-12-06T20:56:29.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112362024-12-06T20:56:29.139ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
112372024-12-06T20:56:29.140ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112382024-12-06T20:56:29.140ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112392024-12-06T20:56:29.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112402024-12-06T20:56:29.161ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
112412024-12-06T20:56:29.161ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 308.897843ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
112422024-12-06T20:56:29.192ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
112432024-12-06T20:56:29.266ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 414.446865ms iteration = 25 status = {}
112442024-12-06T20:56:29.291ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
112452024-12-06T20:56:29.291ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112462024-12-06T20:56:29.292ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf32664c-27f0-4ca2-b1e1-b53840c380ec", "content-length": "372", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} })
112472024-12-06T20:56:29.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112482024-12-06T20:56:29.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112492024-12-06T20:56:29.382ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
112502024-12-06T20:56:29.383ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "76fe522a-9354-4975-8a28-0d78fe82b0ac", "content-length": "691", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} })
112512024-12-06T20:56:29.383ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
112522024-12-06T20:56:29.383ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
112532024-12-06T20:56:29.383ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
112542024-12-06T20:56:29.384ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 532.567229ms iteration = 25 status = {}
112552024-12-06T20:56:29.393ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
112562024-12-06T20:56:29.393ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "045bc0be-2b1a-46d1-86c8-1b6894b0a22e", "content-length": "1", "date": "Fri, 06 Dec 2024 20:56:28 GMT"} })
112572024-12-06T20:56:29.396ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112582024-12-06T20:56:29.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112592024-12-06T20:56:29.399ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 548.367027ms iteration = 25 status = null
112602024-12-06T20:56:29.433ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
112612024-12-06T20:56:29.434ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
112622024-12-06T20:56:29.469ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
112632024-12-06T20:56:29.489ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
112642024-12-06T20:56:29.489ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3faa1af4-c229-4bad-b7a4-d08b0785bab1", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
112652024-12-06T20:56:29.489ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
112662024-12-06T20:56:29.492ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "73361da2-36bf-4849-bd61-deb725cbf650", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
112672024-12-06T20:56:29.492ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
112682024-12-06T20:56:29.495ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
112692024-12-06T20:56:29.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 644.022012ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
112702024-12-06T20:56:29.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112712024-12-06T20:56:29.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112722024-12-06T20:56:29.542ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
112732024-12-06T20:56:29.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112742024-12-06T20:56:29.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112752024-12-06T20:56:29.549ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
112762024-12-06T20:56:29.549ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f55fe901-98ed-4811-97e1-6a100b25a4b9", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112772024-12-06T20:56:29.549ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112782024-12-06T20:56:29.551ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3d2c3989-1f1a-4fd6-8d52-2de314f4667c", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112792024-12-06T20:56:29.551ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112802024-12-06T20:56:29.553ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ceb01d42-69e8-44bd-a64e-1dfe78e44c57", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112812024-12-06T20:56:29.553ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112822024-12-06T20:56:29.556ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112832024-12-06T20:56:29.556ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 704.951394ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
112842024-12-06T20:56:29.556ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
112852024-12-06T20:56:29.556ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dc940ed-4813-4c22-aa6a-9c5ebeb2f47f", "content-length": "134", "date": "Fri, 06 Dec 2024 20:56:28 GMT"} })
112862024-12-06T20:56:29.556ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
112872024-12-06T20:56:29.556ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
112882024-12-06T20:56:29.557ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
112892024-12-06T20:56:29.557ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
112902024-12-06T20:56:29.557ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112912024-12-06T20:56:29.557ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112922024-12-06T20:56:29.557ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112932024-12-06T20:56:29.557ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112942024-12-06T20:56:29.557ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112952024-12-06T20:56:29.557ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112962024-12-06T20:56:29.557ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
112972024-12-06T20:56:29.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112982024-12-06T20:56:29.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112992024-12-06T20:56:29.560ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
113002024-12-06T20:56:29.561ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "863a8eda-9145-4beb-94d9-fa2450b35925", "content-length": "2", "date": "Fri, 06 Dec 2024 20:56:28 GMT"} })
113012024-12-06T20:56:29.561ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
113022024-12-06T20:56:29.561ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "42bffc14-5bee-4776-a8a6-118f928f9c6f", "content-length": "52", "date": "Fri, 06 Dec 2024 20:56:28 GMT"} })
113032024-12-06T20:56:29.561ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
113042024-12-06T20:56:29.561ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
113052024-12-06T20:56:29.568ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d2910d0c-d2cc-4f9e-b4aa-9590335049ac", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} })
113062024-12-06T20:56:29.568ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113072024-12-06T20:56:29.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113082024-12-06T20:56:29.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113092024-12-06T20:56:29.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113102024-12-06T20:56:29.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113112024-12-06T20:56:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113122024-12-06T20:56:29.579ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
113132024-12-06T20:56:29.579ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113142024-12-06T20:56:29.580ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0a75cb61-5ea4-4049-9043-d614b873fe3a", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} })
113152024-12-06T20:56:29.583ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 730.986655ms iteration = 25 status = {}
113162024-12-06T20:56:29.663ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "01c1ba55-9daf-44ae-b327-6ded8472f81b", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} })
113172024-12-06T20:56:29.663ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
113182024-12-06T20:56:29.663ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
113192024-12-06T20:56:29.663ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "32c8b7b7-fe99-4c1f-806f-9461114c7462", "content-length": "682", "date": "Fri, 06 Dec 2024 20:56:29 GMT"} })
113202024-12-06T20:56:29.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113212024-12-06T20:56:29.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113222024-12-06T20:56:29.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113232024-12-06T20:56:29.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113242024-12-06T20:56:29.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113252024-12-06T20:56:29.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113262024-12-06T20:56:29.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113272024-12-06T20:56:29.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113282024-12-06T20:56:29.681ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 829.033053ms iteration = 25 status = {}
113292024-12-06T20:56:30.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6e8a0582-9f71-4cb9-a6b7-f91efac9ed70 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113302024-12-06T20:56:30.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6e8a0582-9f71-4cb9-a6b7-f91efac9ed70 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113312024-12-06T20:56:30.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6e8a0582-9f71-4cb9-a6b7-f91efac9ed70 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113322024-12-06T20:56:31.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 79386feb-6e9b-497d-b7e3-e6faa8713d85 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113332024-12-06T20:56:31.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 79386feb-6e9b-497d-b7e3-e6faa8713d85 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113342024-12-06T20:56:31.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 79386feb-6e9b-497d-b7e3-e6faa8713d85 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113352024-12-06T20:56:32.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 831989c9-dede-425e-96ac-23c51a4e1014 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113362024-12-06T20:56:32.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 831989c9-dede-425e-96ac-23c51a4e1014 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113372024-12-06T20:56:32.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 831989c9-dede-425e-96ac-23c51a4e1014 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113382024-12-06T20:56:32.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 9b1167f1-18ab-4565-8206-cabe20367f0f response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
113392024-12-06T20:56:33.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 183e1e8c-ca95-4788-9fa5-ecca3d9a3ccf roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113402024-12-06T20:56:33.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 183e1e8c-ca95-4788-9fa5-ecca3d9a3ccf resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113412024-12-06T20:56:33.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 183e1e8c-ca95-4788-9fa5-ecca3d9a3ccf response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113422024-12-06T20:56:34.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3706d7a6-5c08-4edc-8a7e-40056d5d1bf9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113432024-12-06T20:56:34.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3706d7a6-5c08-4edc-8a7e-40056d5d1bf9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113442024-12-06T20:56:34.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3706d7a6-5c08-4edc-8a7e-40056d5d1bf9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113452024-12-06T20:56:35.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c9604cf5-545d-4efe-98b1-0673317a7432 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113462024-12-06T20:56:35.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c9604cf5-545d-4efe-98b1-0673317a7432 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113472024-12-06T20:56:35.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c9604cf5-545d-4efe-98b1-0673317a7432 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113482024-12-06T20:56:36.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 398bb5f1-1c61-4038-ba13-055d0781eb1f roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113492024-12-06T20:56:36.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 398bb5f1-1c61-4038-ba13-055d0781eb1f resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113502024-12-06T20:56:36.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 398bb5f1-1c61-4038-ba13-055d0781eb1f response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113512024-12-06T20:56:37.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea267b03-3fcc-40a7-adaf-db1558447221 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113522024-12-06T20:56:37.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea267b03-3fcc-40a7-adaf-db1558447221 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113532024-12-06T20:56:37.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea267b03-3fcc-40a7-adaf-db1558447221 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113542024-12-06T20:56:38.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 773caf57-7d23-4890-8790-e4947cfc7110 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113552024-12-06T20:56:38.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 773caf57-7d23-4890-8790-e4947cfc7110 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113562024-12-06T20:56:38.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 773caf57-7d23-4890-8790-e4947cfc7110 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113572024-12-06T20:56:38.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
113582024-12-06T20:56:38.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
113592024-12-06T20:56:38.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113602024-12-06T20:56:38.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113612024-12-06T20:56:38.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113622024-12-06T20:56:38.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113632024-12-06T20:56:38.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113642024-12-06T20:56:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113652024-12-06T20:56:38.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113662024-12-06T20:56:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113672024-12-06T20:56:38.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113682024-12-06T20:56:38.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113692024-12-06T20:56:38.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113702024-12-06T20:56:38.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113712024-12-06T20:56:38.888ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113722024-12-06T20:56:38.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
113732024-12-06T20:56:38.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113742024-12-06T20:56:38.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113752024-12-06T20:56:38.905ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
113762024-12-06T20:56:38.906ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.559381ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
113772024-12-06T20:56:38.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.347328ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113782024-12-06T20:56:39.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d47c7a0d-2965-4e19-836d-1a6925a42b7b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113792024-12-06T20:56:39.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d47c7a0d-2965-4e19-836d-1a6925a42b7b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113802024-12-06T20:56:39.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d47c7a0d-2965-4e19-836d-1a6925a42b7b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113812024-12-06T20:56:40.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9c06a86e-fc6f-4f60-a13d-c9dede4ca8b6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113822024-12-06T20:56:40.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9c06a86e-fc6f-4f60-a13d-c9dede4ca8b6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113832024-12-06T20:56:40.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9c06a86e-fc6f-4f60-a13d-c9dede4ca8b6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113842024-12-06T20:56:41.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4a62a05b-9747-4e94-9f6d-0831e8c2ed95 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113852024-12-06T20:56:41.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4a62a05b-9747-4e94-9f6d-0831e8c2ed95 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113862024-12-06T20:56:41.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4a62a05b-9747-4e94-9f6d-0831e8c2ed95 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113872024-12-06T20:56:42.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d805e613-0550-48bd-90ee-9686e11a02bb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113882024-12-06T20:56:42.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d805e613-0550-48bd-90ee-9686e11a02bb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113892024-12-06T20:56:42.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d805e613-0550-48bd-90ee-9686e11a02bb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113902024-12-06T20:56:42.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 444 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 21ab2491-62da-4c6c-adef-01659b09d140 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
113912024-12-06T20:56:43.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c424f2d5-20e1-4c61-b69f-1415dea7e493 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113922024-12-06T20:56:43.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c424f2d5-20e1-4c61-b69f-1415dea7e493 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113932024-12-06T20:56:43.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c424f2d5-20e1-4c61-b69f-1415dea7e493 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113942024-12-06T20:56:44.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e42948a9-d459-4fad-b8b6-4f882c4af4b5 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113952024-12-06T20:56:44.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e42948a9-d459-4fad-b8b6-4f882c4af4b5 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113962024-12-06T20:56:44.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e42948a9-d459-4fad-b8b6-4f882c4af4b5 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113972024-12-06T20:56:45.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d2059004-a536-4105-a032-0862dd80c966 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113982024-12-06T20:56:45.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d2059004-a536-4105-a032-0862dd80c966 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
113992024-12-06T20:56:45.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d2059004-a536-4105-a032-0862dd80c966 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114002024-12-06T20:56:46.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f3c3d1a8-a0c3-476d-9bac-0c4064696f83 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114012024-12-06T20:56:46.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f3c3d1a8-a0c3-476d-9bac-0c4064696f83 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114022024-12-06T20:56:46.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f3c3d1a8-a0c3-476d-9bac-0c4064696f83 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114032024-12-06T20:56:47.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3dae08bf-995a-4454-ac26-59c6d73f3061 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114042024-12-06T20:56:47.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3dae08bf-995a-4454-ac26-59c6d73f3061 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114052024-12-06T20:56:47.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3dae08bf-995a-4454-ac26-59c6d73f3061 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114062024-12-06T20:56:48.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f0cf5f87-01a2-4e6c-9261-353ee87123e8 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114072024-12-06T20:56:48.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f0cf5f87-01a2-4e6c-9261-353ee87123e8 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114082024-12-06T20:56:48.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f0cf5f87-01a2-4e6c-9261-353ee87123e8 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114092024-12-06T20:56:48.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
114102024-12-06T20:56:48.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
114112024-12-06T20:56:48.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114122024-12-06T20:56:48.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114132024-12-06T20:56:48.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114142024-12-06T20:56:48.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114152024-12-06T20:56:48.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114162024-12-06T20:56:48.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114172024-12-06T20:56:48.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114182024-12-06T20:56:48.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114192024-12-06T20:56:48.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114202024-12-06T20:56:48.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114212024-12-06T20:56:48.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114222024-12-06T20:56:48.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
114232024-12-06T20:56:48.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114242024-12-06T20:56:48.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114252024-12-06T20:56:48.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
114262024-12-06T20:56:48.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.314939ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
114272024-12-06T20:56:48.882ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114282024-12-06T20:56:48.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114292024-12-06T20:56:48.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.541024ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114302024-12-06T20:56:49.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3220785a-7354-42af-991a-1048191f3a61 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114312024-12-06T20:56:49.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3220785a-7354-42af-991a-1048191f3a61 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114322024-12-06T20:56:49.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3220785a-7354-42af-991a-1048191f3a61 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114332024-12-06T20:56:50.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b02d756b-f9a1-4fd2-a20b-2062447bf310 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114342024-12-06T20:56:50.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b02d756b-f9a1-4fd2-a20b-2062447bf310 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114352024-12-06T20:56:50.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b02d756b-f9a1-4fd2-a20b-2062447bf310 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114362024-12-06T20:56:51.341ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2109 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ca3260ab-a753-4016-bc6a-50b27e405203 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-06T20:56:51.319576399Z }
114372024-12-06T20:56:51.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ca3260ab-a753-4016-bc6a-50b27e405203 roles = RoleSet { roles: {} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
114382024-12-06T20:56:51.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ca3260ab-a753-4016-bc6a-50b27e405203 resource = Database result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
114392024-12-06T20:56:51.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37720 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ca3260ab-a753-4016-bc6a-50b27e405203 response_code = 204 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
114402024-12-06T20:56:51.359ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2109 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a9f3a601-3fe4-4e21-824d-62ca2bbd4f33 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-06T20:56:51.358804901Z }
114412024-12-06T20:56:51.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a9f3a601-3fe4-4e21-824d-62ca2bbd4f33 roles = RoleSet { roles: {} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
114422024-12-06T20:56:51.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a9f3a601-3fe4-4e21-824d-62ca2bbd4f33 resource = Database result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
114432024-12-06T20:56:51.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35737 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a9f3a601-3fe4-4e21-824d-62ca2bbd4f33 response_code = 204 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
114442024-12-06T20:56:51.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d7917d8c-0bff-4fb9-a75f-de8223a62aec roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114452024-12-06T20:56:51.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d7917d8c-0bff-4fb9-a75f-de8223a62aec resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114462024-12-06T20:56:51.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d7917d8c-0bff-4fb9-a75f-de8223a62aec response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114472024-12-06T20:56:52.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 499 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 4c29591e-5118-42db-a379-1138720f5040 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
114482024-12-06T20:56:52.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 85b83cab-a2f8-47c8-a64b-b74f0fd86fca roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114492024-12-06T20:56:52.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 85b83cab-a2f8-47c8-a64b-b74f0fd86fca resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114502024-12-06T20:56:52.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 85b83cab-a2f8-47c8-a64b-b74f0fd86fca response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114512024-12-06T20:56:53.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f30ea5cc-b926-4ea3-afd9-18f6fed78036 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114522024-12-06T20:56:53.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f30ea5cc-b926-4ea3-afd9-18f6fed78036 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114532024-12-06T20:56:53.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f30ea5cc-b926-4ea3-afd9-18f6fed78036 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114542024-12-06T20:56:54.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc45771a-6af5-490a-a59d-236b745055dd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114552024-12-06T20:56:54.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc45771a-6af5-490a-a59d-236b745055dd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114562024-12-06T20:56:54.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc45771a-6af5-490a-a59d-236b745055dd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114572024-12-06T20:56:55.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 930f235d-0d90-4466-b463-f070b51a7f65 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114582024-12-06T20:56:55.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 930f235d-0d90-4466-b463-f070b51a7f65 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114592024-12-06T20:56:55.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 930f235d-0d90-4466-b463-f070b51a7f65 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114602024-12-06T20:56:56.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce656e74-d86c-4ad5-86a9-3cf7bfd8c092 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114612024-12-06T20:56:56.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce656e74-d86c-4ad5-86a9-3cf7bfd8c092 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114622024-12-06T20:56:56.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ce656e74-d86c-4ad5-86a9-3cf7bfd8c092 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114632024-12-06T20:56:57.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = ea4b0f4a-ba27-4808-a37c-34c23826794d roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
114642024-12-06T20:56:57.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = ea4b0f4a-ba27-4808-a37c-34c23826794d resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
114652024-12-06T20:56:57.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = ea4b0f4a-ba27-4808-a37c-34c23826794d response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
114662024-12-06T20:56:57.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 3b806227-4f3b-4ae0-8c3f-416db98abb72 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
114672024-12-06T20:56:57.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 3b806227-4f3b-4ae0-8c3f-416db98abb72 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
114682024-12-06T20:56:57.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 3b806227-4f3b-4ae0-8c3f-416db98abb72 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
114692024-12-06T20:56:57.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f068438e-4e30-4689-b7fd-7c4fe5765816 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114702024-12-06T20:56:57.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f068438e-4e30-4689-b7fd-7c4fe5765816 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114712024-12-06T20:56:57.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f068438e-4e30-4689-b7fd-7c4fe5765816 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114722024-12-06T20:56:58.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e0cd392-4bc2-47df-89b5-ff20a1b0328b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114732024-12-06T20:56:58.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e0cd392-4bc2-47df-89b5-ff20a1b0328b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114742024-12-06T20:56:58.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e0cd392-4bc2-47df-89b5-ff20a1b0328b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
114752024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
114762024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114772024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
114782024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
114792024-12-06T20:56:58.851ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
114802024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114812024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
114822024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
114832024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
114842024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114852024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
114862024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
114872024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114882024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
114892024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
114902024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114912024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
114922024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
114932024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114942024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114952024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
114962024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
114972024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
114982024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114992024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
115002024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
115012024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115022024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
115032024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
115042024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
115052024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115062024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
115072024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
115082024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
115092024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115102024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
115112024-12-06T20:56:58.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115122024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115132024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115142024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
115152024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115162024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
115172024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115182024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115192024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115202024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115212024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115222024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
115232024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115242024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115252024-12-06T20:56:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
115262024-12-06T20:56:58.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6949, tv_nsec: 195398544 } })
115272024-12-06T20:56:58.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115282024-12-06T20:56:58.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
115292024-12-06T20:56:58.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115302024-12-06T20:56:58.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115312024-12-06T20:56:58.856ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.192178ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
115322024-12-06T20:56:58.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6949, tv_nsec: 197296923 } })
115332024-12-06T20:56:58.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
115342024-12-06T20:56:58.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
115352024-12-06T20:56:58.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115362024-12-06T20:56:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115372024-12-06T20:56:58.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
115382024-12-06T20:56:58.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
115392024-12-06T20:56:58.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
115402024-12-06T20:56:58.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115412024-12-06T20:56:58.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115422024-12-06T20:56:58.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115432024-12-06T20:56:58.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115442024-12-06T20:56:58.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
115452024-12-06T20:56:58.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115462024-12-06T20:56:58.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115472024-12-06T20:56:58.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115482024-12-06T20:56:58.877ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6949, tv_nsec: 218977122 } })
115492024-12-06T20:56:58.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115502024-12-06T20:56:58.878ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
115512024-12-06T20:56:58.886ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115522024-12-06T20:56:58.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
115532024-12-06T20:56:58.891ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115542024-12-06T20:56:58.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115552024-12-06T20:56:58.914ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115562024-12-06T20:56:58.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115572024-12-06T20:56:58.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.568159ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
115582024-12-06T20:56:58.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115592024-12-06T20:56:58.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115602024-12-06T20:56:58.917ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
115612024-12-06T20:56:58.917ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
115622024-12-06T20:56:58.917ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.814737ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
115632024-12-06T20:56:58.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
115642024-12-06T20:56:58.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.185243ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
115652024-12-06T20:56:58.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
115662024-12-06T20:56:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115672024-12-06T20:56:58.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115682024-12-06T20:56:58.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
115692024-12-06T20:56:58.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115702024-12-06T20:56:58.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
115712024-12-06T20:56:58.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115722024-12-06T20:56:58.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115732024-12-06T20:56:58.921ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115742024-12-06T20:56:58.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115752024-12-06T20:56:58.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115762024-12-06T20:56:58.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115772024-12-06T20:56:58.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115782024-12-06T20:56:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115792024-12-06T20:56:58.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115802024-12-06T20:56:58.925ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
115812024-12-06T20:56:58.925ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115822024-12-06T20:56:58.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115832024-12-06T20:56:58.925ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115842024-12-06T20:56:58.928ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115852024-12-06T20:56:58.928ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
115862024-12-06T20:56:58.928ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115872024-12-06T20:56:58.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115882024-12-06T20:56:58.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115892024-12-06T20:56:58.928ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115902024-12-06T20:56:58.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115912024-12-06T20:56:58.957ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115922024-12-06T20:56:58.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115932024-12-06T20:56:58.960ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
115942024-12-06T20:56:58.960ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115952024-12-06T20:56:58.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.899717ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
115962024-12-06T20:56:58.960ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5eab526d-2668-45d9-87e9-27b6d48be8e7", "content-length": "26", "date": "Fri, 06 Dec 2024 20:56:58 GMT"} })
115972024-12-06T20:56:58.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115982024-12-06T20:56:58.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115992024-12-06T20:56:58.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116002024-12-06T20:56:58.962ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116012024-12-06T20:56:58.962ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116022024-12-06T20:56:58.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 111.857434ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116032024-12-06T20:56:58.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
116042024-12-06T20:56:58.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116052024-12-06T20:56:58.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116062024-12-06T20:56:58.966ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116072024-12-06T20:56:58.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
116082024-12-06T20:56:58.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 117.236132ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
116092024-12-06T20:56:58.969ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116102024-12-06T20:56:58.969ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
116112024-12-06T20:56:58.969ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116122024-12-06T20:56:58.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116132024-12-06T20:56:59.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116142024-12-06T20:56:59.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116152024-12-06T20:56:59.049ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 197.471211ms iteration = 29 status = {"physical_disks_added":0}
116162024-12-06T20:56:59.063ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
116172024-12-06T20:56:59.063ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "07708fd6-1df9-40ec-b612-a8b2bd864f9c", "content-length": "1", "date": "Fri, 06 Dec 2024 20:56:58 GMT"} })
116182024-12-06T20:56:59.064ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
116192024-12-06T20:56:59.064ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116202024-12-06T20:56:59.064ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a144909e-dc8c-44b7-a6f5-c9d7604c94cc", "content-length": "26", "date": "Fri, 06 Dec 2024 20:56:58 GMT"} })
116212024-12-06T20:56:59.064ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116222024-12-06T20:56:59.065ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
116232024-12-06T20:56:59.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
116242024-12-06T20:56:59.066ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
116252024-12-06T20:56:59.066ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
116262024-12-06T20:56:59.066ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
116272024-12-06T20:56:59.067ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79/state
116282024-12-06T20:56:59.067ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fad3f9b4-61c4-456e-b6e1-09ad9074ca95", "content-length": "26", "date": "Fri, 06 Dec 2024 20:56:58 GMT"} })
116292024-12-06T20:56:59.067ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
116302024-12-06T20:56:59.068ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "857b3776-179b-4e14-b8ef-e6df6cffa05c", "content-length": "130", "date": "Fri, 06 Dec 2024 20:56:59 GMT"} })
116312024-12-06T20:56:59.069ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 217.21682ms iteration = 26 status = 0
116322024-12-06T20:56:59.069ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
116332024-12-06T20:56:59.069ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 217.798265ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
116342024-12-06T20:56:59.076ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-06T20:56:51.358804901Z }, migration_in: None, migration_out: None } vmm_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
116352024-12-06T20:56:59.076ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2109 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 sled_id = 0a667526-2006-419e-9b68-c251fd138c06 vmm_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-06T20:56:51.358804901Z }
116362024-12-06T20:56:59.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 roles = RoleSet { roles: {} } sled_id = 0a667526-2006-419e-9b68-c251fd138c06 vmm_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
116372024-12-06T20:56:59.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 resource = Database result = Ok(()) sled_id = 0a667526-2006-419e-9b68-c251fd138c06 vmm_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79
116382024-12-06T20:56:59.097ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116392024-12-06T20:56:59.097ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
116402024-12-06T20:56:59.097ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 245.756266ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
116412024-12-06T20:56:59.116ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
116422024-12-06T20:56:59.116ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116432024-12-06T20:56:59.116ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e465527-9338-4cff-8e67-9808376d62ee", "content-length": "583", "date": "Fri, 06 Dec 2024 20:56:59 GMT"} })
116442024-12-06T20:56:59.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116452024-12-06T20:56:59.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116462024-12-06T20:56:59.119ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 268.171444ms iteration = 26 status = null
116472024-12-06T20:56:59.147ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 296.194446ms iteration = 26 status = {}
116482024-12-06T20:56:59.149ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
116492024-12-06T20:56:59.150ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 299.07864ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
116502024-12-06T20:56:59.163ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {6b2b7eab-a7a3-488e-8a11-aefb815fdab9: {10.151.2.176: {8dd4f499-a809-40eb-9cb9-0aeb312d5997}, 10.151.2.175: {8dd4f499-a809-40eb-9cb9-0aeb312d5997}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
116512024-12-06T20:56:59.163ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
116522024-12-06T20:56:59.163ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e8b44506-19f1-4f36-88c6-99414c4b408a", "date": "Fri, 06 Dec 2024 20:56:59 GMT"} })
116532024-12-06T20:56:59.163ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116542024-12-06T20:56:59.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116552024-12-06T20:56:59.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116562024-12-06T20:56:59.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116572024-12-06T20:56:59.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116582024-12-06T20:56:59.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116592024-12-06T20:56:59.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116602024-12-06T20:56:59.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116612024-12-06T20:56:59.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116622024-12-06T20:56:59.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116632024-12-06T20:56:59.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116642024-12-06T20:56:59.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116652024-12-06T20:56:59.183ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
116662024-12-06T20:56:59.183ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
116672024-12-06T20:56:59.183ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
116682024-12-06T20:56:59.183ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bd07c311-3100-491d-bc46-70318da29e65", "date": "Fri, 06 Dec 2024 20:56:59 GMT"} })
116692024-12-06T20:56:59.185ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 333.415566ms iteration = 26 status = {}
116702024-12-06T20:56:59.208ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116712024-12-06T20:56:59.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116722024-12-06T20:56:59.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116732024-12-06T20:56:59.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116742024-12-06T20:56:59.211ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
116752024-12-06T20:56:59.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116762024-12-06T20:56:59.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116772024-12-06T20:56:59.223ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
116782024-12-06T20:56:59.224ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d61c7f0f-2035-491a-9965-18b8c8363b13", "content-length": "134", "date": "Fri, 06 Dec 2024 20:56:58 GMT"} })
116792024-12-06T20:56:59.224ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
116802024-12-06T20:56:59.224ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
116812024-12-06T20:56:59.224ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
116822024-12-06T20:56:59.224ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
116832024-12-06T20:56:59.224ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116842024-12-06T20:56:59.224ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116852024-12-06T20:56:59.224ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116862024-12-06T20:56:59.224ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116872024-12-06T20:56:59.224ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116882024-12-06T20:56:59.224ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116892024-12-06T20:56:59.225ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
116902024-12-06T20:56:59.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116912024-12-06T20:56:59.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116922024-12-06T20:56:59.227ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
116932024-12-06T20:56:59.227ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3377c387-ab45-42b5-ba8b-f191462eba09", "content-length": "2", "date": "Fri, 06 Dec 2024 20:56:58 GMT"} })
116942024-12-06T20:56:59.227ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
116952024-12-06T20:56:59.227ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdf2274c-2e2b-4e7d-9b69-fef7d18d9b1e", "content-length": "52", "date": "Fri, 06 Dec 2024 20:56:58 GMT"} })
116962024-12-06T20:56:59.227ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
116972024-12-06T20:56:59.227ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
116982024-12-06T20:56:59.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116992024-12-06T20:56:59.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
117002024-12-06T20:56:59.252ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117012024-12-06T20:56:59.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117022024-12-06T20:56:59.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117032024-12-06T20:56:59.283ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
117042024-12-06T20:56:59.283ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117052024-12-06T20:56:59.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117062024-12-06T20:56:59.319ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8c3174fc-302a-43c0-92f5-c8ca41620db9", "date": "Fri, 06 Dec 2024 20:56:59 GMT"} })
117072024-12-06T20:56:59.319ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
117082024-12-06T20:56:59.319ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
117092024-12-06T20:56:59.323ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "48afbc98-4e8d-4afc-ac85-b0efafb28295", "content-length": "682", "date": "Fri, 06 Dec 2024 20:56:59 GMT"} })
117102024-12-06T20:56:59.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117112024-12-06T20:56:59.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117122024-12-06T20:56:59.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117132024-12-06T20:56:59.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117142024-12-06T20:56:59.330ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117152024-12-06T20:56:59.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117162024-12-06T20:56:59.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117172024-12-06T20:56:59.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117182024-12-06T20:56:59.339ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 487.868157ms iteration = 26 status = {}
117192024-12-06T20:56:59.370ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
117202024-12-06T20:56:59.371ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "baa89c19-d37b-4dfa-bf7d-a4f574f14371", "content-length": "810", "date": "Fri, 06 Dec 2024 20:56:59 GMT"} })
117212024-12-06T20:56:59.371ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(6629825) }} sled = sock
117222024-12-06T20:56:59.371ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
117232024-12-06T20:56:59.371ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
117242024-12-06T20:56:59.373ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 522.08197ms iteration = 26 status = {}
117252024-12-06T20:56:59.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b10d4e6b-1e20-4fd9-a239-b6369e5a299c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117262024-12-06T20:56:59.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b10d4e6b-1e20-4fd9-a239-b6369e5a299c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117272024-12-06T20:56:59.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b10d4e6b-1e20-4fd9-a239-b6369e5a299c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117282024-12-06T20:57:00.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c7df13a9-7f15-4166-b2d9-f9b87aa1f1cd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117292024-12-06T20:57:00.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c7df13a9-7f15-4166-b2d9-f9b87aa1f1cd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117302024-12-06T20:57:00.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c7df13a9-7f15-4166-b2d9-f9b87aa1f1cd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117312024-12-06T20:57:01.712ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2109 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 417ccdfb-5069-4d7e-a131-f25996b234ee uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-06T20:57:01.712105619Z }
117322024-12-06T20:57:01.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 417ccdfb-5069-4d7e-a131-f25996b234ee roles = RoleSet { roles: {} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117332024-12-06T20:57:01.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 417ccdfb-5069-4d7e-a131-f25996b234ee resource = Database result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117342024-12-06T20:57:01.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43025 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 417ccdfb-5069-4d7e-a131-f25996b234ee response_code = 204 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117352024-12-06T20:57:01.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 57ab6c9c-164a-4c19-8275-585c51f77e8d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117362024-12-06T20:57:01.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 57ab6c9c-164a-4c19-8275-585c51f77e8d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117372024-12-06T20:57:01.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 57ab6c9c-164a-4c19-8275-585c51f77e8d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117382024-12-06T20:57:02.419ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8259 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = a74f33d5-5389-4e2d-a6d4-cc9584734fe5 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
117392024-12-06T20:57:02.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b1ed556-47d1-492e-b6ad-473bc0ec88b6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117402024-12-06T20:57:02.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b1ed556-47d1-492e-b6ad-473bc0ec88b6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117412024-12-06T20:57:02.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b1ed556-47d1-492e-b6ad-473bc0ec88b6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117422024-12-06T20:57:03.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e98d23ee-039a-4cb1-a2c4-b8194cbb36b6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117432024-12-06T20:57:03.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e98d23ee-039a-4cb1-a2c4-b8194cbb36b6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117442024-12-06T20:57:03.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e98d23ee-039a-4cb1-a2c4-b8194cbb36b6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
117452024-12-06T20:57:04.161ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2109 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T20:57:04.161173837Z }
117462024-12-06T20:57:04.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 roles = RoleSet { roles: {} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117472024-12-06T20:57:04.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 resource = Database result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117482024-12-06T20:57:04.170ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79 vmm_needs_update = true
117492024-12-06T20:57:04.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 roles = RoleSet { roles: {} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117502024-12-06T20:57:04.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 resource = Database result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117512024-12-06T20:57:04.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 roles = RoleSet { roles: {} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117522024-12-06T20:57:04.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 resource = Database result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117532024-12-06T20:57:04.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 roles = RoleSet { roles: {} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117542024-12-06T20:57:04.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 resource = Database result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117552024-12-06T20:57:04.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 roles = RoleSet { roles: {} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117562024-12-06T20:57:04.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 resource = Database result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117572024-12-06T20:57:04.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 roles = RoleSet { roles: {} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117582024-12-06T20:57:04.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 resource = Database result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117592024-12-06T20:57:04.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 roles = RoleSet { roles: {} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117602024-12-06T20:57:04.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 resource = Database result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117612024-12-06T20:57:04.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117622024-12-06T20:57:04.249ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 435e56bf-fa70-439f-8ad1-7c07c9948190, lookup_type: ById(435e56bf-fa70-439f-8ad1-7c07c9948190) }, key: b8c9ca73-67e6-4aea-b6fc-902530f58ce8, lookup_type: ById(b8c9ca73-67e6-4aea-b6fc-902530f58ce8) }, key: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978, lookup_type: ById(8e6b6db4-837f-4eb1-b0b2-b51d7f30c978) } result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117632024-12-06T20:57:04.254ZINFOnexus (dropshot_internal): starting update saga for 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1576 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T20:57:04.161173837Z }
117642024-12-06T20:57:04.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92870 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 response_code = 204 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117652024-12-06T20:57:04.254ZDEBGnexus (dropshot_internal): preparing instance-update saga for 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = aca1ded0-5b69-4b39-b7ce-019e5e2fb000 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117662024-12-06T20:57:04.254ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2109 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6bf6e49-d8a4-4b40-9e33-cb594ef496e9 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T20:57:04.161173837Z }
117672024-12-06T20:57:04.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6bf6e49-d8a4-4b40-9e33-cb594ef496e9 roles = RoleSet { roles: {} } uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117682024-12-06T20:57:04.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6bf6e49-d8a4-4b40-9e33-cb594ef496e9 resource = Database result = Ok(()) uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117692024-12-06T20:57:04.256ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update
117702024-12-06T20:57:04.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4108 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c6bf6e49-d8a4-4b40-9e33-cb594ef496e9 response_code = 204 uri = /vmms/92607f49-ba1c-4ddf-87a1-60c0c155ce79
117712024-12-06T20:57:04.259ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"8e6b6db4-837f-4eb1-b0b2-b51d7f30c978","lookup_type":{"ById":"8e6b6db4-837f-4eb1-b0b2-b51d7f30c978"},"parent":{"key":"b8c9ca73-67e6-4aea-b6fc-902530f58ce8","lookup_type":{"ById":"b8c9ca73-67e6-4aea-b6fc-902530f58ce8"},"parent":{"key":"435e56bf-fa70-439f-8ad1-7c07c9948190","lookup_type":{"ById":"435e56bf-fa70-439f-8ad1-7c07c9948190"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
117722024-12-06T20:57:04.259ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update
117732024-12-06T20:57:04.300ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update
117742024-12-06T20:57:04.300ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
117752024-12-06T20:57:04.305ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
117762024-12-06T20:57:04.305ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1
117772024-12-06T20:57:04.309ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
117782024-12-06T20:57:04.309ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1
117792024-12-06T20:57:04.313ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
117802024-12-06T20:57:04.313ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1
117812024-12-06T20:57:04.318ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
117822024-12-06T20:57:04.318ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("11766e38-0b86-4217-a991-6d0e43a8daf6")) node_id = 0 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1
117832024-12-06T20:57:04.325ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
117842024-12-06T20:57:04.325ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1
117852024-12-06T20:57:04.340ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update
117862024-12-06T20:57:04.343ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117872024-12-06T20:57:04.343ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117882024-12-06T20:57:04.345ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117892024-12-06T20:57:04.345ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117902024-12-06T20:57:04.347ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117912024-12-06T20:57:04.347ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117922024-12-06T20:57:04.351ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117932024-12-06T20:57:04.352ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117942024-12-06T20:57:04.352ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117952024-12-06T20:57:04.353ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117962024-12-06T20:57:04.378ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117972024-12-06T20:57:04.379ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117982024-12-06T20:57:04.380ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
117992024-12-06T20:57:04.383ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 435e56bf-fa70-439f-8ad1-7c07c9948190, lookup_type: ById(435e56bf-fa70-439f-8ad1-7c07c9948190) }, key: b8c9ca73-67e6-4aea-b6fc-902530f58ce8, lookup_type: ById(b8c9ca73-67e6-4aea-b6fc-902530f58ce8) }, key: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978, lookup_type: ById(8e6b6db4-837f-4eb1-b0b2-b51d7f30c978) } result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
118002024-12-06T20:57:04.383ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance updater_id = 11766e38-0b86-4217-a991-6d0e43a8daf6
118012024-12-06T20:57:04.383ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
118022024-12-06T20:57:04.383ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
118032024-12-06T20:57:04.402ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance updater_id = 11766e38-0b86-4217-a991-6d0e43a8daf6
118042024-12-06T20:57:04.402ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
118052024-12-06T20:57:04.403ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance
118062024-12-06T20:57:04.407ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 locked_gen = Generation(Generation(2)) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = LockInstance updater_id = 11766e38-0b86-4217-a991-6d0e43a8daf6
118072024-12-06T20:57:04.409ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118082024-12-06T20:57:04.409ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("11766e38-0b86-4217-a991-6d0e43a8daf6")}) node_id = 1 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1
118092024-12-06T20:57:04.414ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118102024-12-06T20:57:04.414ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1
118112024-12-06T20:57:04.420ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
118122024-12-06T20:57:04.421ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
118132024-12-06T20:57:04.422ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
118142024-12-06T20:57:04.423ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
118152024-12-06T20:57:04.424ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
118162024-12-06T20:57:04.424ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
118172024-12-06T20:57:04.426ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
118182024-12-06T20:57:04.429ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 435e56bf-fa70-439f-8ad1-7c07c9948190, lookup_type: ById(435e56bf-fa70-439f-8ad1-7c07c9948190) }, key: b8c9ca73-67e6-4aea-b6fc-902530f58ce8, lookup_type: ById(b8c9ca73-67e6-4aea-b6fc-902530f58ce8) }, key: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978, lookup_type: ById(8e6b6db4-837f-4eb1-b0b2-b51d7f30c978) } result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
118192024-12-06T20:57:04.429ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
118202024-12-06T20:57:04.429ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
118212024-12-06T20:57:04.435ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 92607f49-ba1c-4ddf-87a1-60c0c155ce79, time_created: 2024-12-06T20:56:43.456377Z, time_deleted: None, instance_id: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978, sled_id: 0a667526-2006-419e-9b68-c251fd138c06, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-06T20:57:04.161173Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-06T20:56:41.169939Z, gen: Generation(Generation(3)), propolis_id: Some(92607f49-ba1c-4ddf-87a1-60c0c155ce79), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(92607f49-ba1c-4ddf-87a1-60c0c155ce79 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-06T20:57:04.435123899Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
118222024-12-06T20:57:04.437ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118232024-12-06T20:57:04.437ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"8e6b6db4-837f-4eb1-b0b2-b51d7f30c978","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"92607f49-ba1c-4ddf-87a1-60c0c155ce79"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"8e6b6db4-837f-4eb1-b0b2-b51d7f30c978","lookup_type":{"ById":"8e6b6db4-837f-4eb1-b0b2-b51d7f30c978"},"parent":{"key":"b8c9ca73-67e6-4aea-b6fc-902530f58ce8","lookup_type":{"ById":"b8c9ca73-67e6-4aea-b6fc-902530f58ce8"},"parent":{"key":"435e56bf-fa70-439f-8ad1-7c07c9948190","lookup_type":{"ById":"435e56bf-fa70-439f-8ad1-7c07c9948190"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"11766e38-0b86-4217-a991-6d0e43a8daf6"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"b8c9ca73-67e6-4aea-b6fc-902530f58ce8","ram_diff":1073741824},"destroy_active_vmm":"92607f49-ba1c-4ddf-87a1-60c0c155ce79","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-06T20:57:04.435123899Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118242024-12-06T20:57:04.437ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118252024-12-06T20:57:04.442ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118262024-12-06T20:57:04.442ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118272024-12-06T20:57:04.442ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118282024-12-06T20:57:04.442ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118292024-12-06T20:57:04.446ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118302024-12-06T20:57:04.446ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118312024-12-06T20:57:04.450ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118322024-12-06T20:57:04.450ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118332024-12-06T20:57:04.453ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118342024-12-06T20:57:04.453ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ca3159ca-75e8-40fe-aa89-de99dbfdf741")) node_id = 0 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118352024-12-06T20:57:04.457ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118362024-12-06T20:57:04.457ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118372024-12-06T20:57:04.465ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 parent_lock = UpdaterLock { updater_id: 11766e38-0b86-4217-a991-6d0e43a8daf6, locked_gen: Generation(Generation(2)) } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118382024-12-06T20:57:04.465ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = BecomeUpdater
118392024-12-06T20:57:04.465ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = BecomeUpdater
118402024-12-06T20:57:04.474ZDEBGnexus (SagaExecutor): inherited lock from 11766e38-0b86-4217-a991-6d0e43a8daf6 to ca3159ca-75e8-40fe-aa89-de99dbfdf741 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 11766e38-0b86-4217-a991-6d0e43a8daf6 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = BecomeUpdater updater_id = ca3159ca-75e8-40fe-aa89-de99dbfdf741
118412024-12-06T20:57:04.477ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118422024-12-06T20:57:04.477ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118432024-12-06T20:57:04.477ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ca3159ca-75e8-40fe-aa89-de99dbfdf741")}) node_id = 1 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118442024-12-06T20:57:04.480ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118452024-12-06T20:57:04.480ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118462024-12-06T20:57:04.483ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118472024-12-06T20:57:04.483ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118482024-12-06T20:57:04.487ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118492024-12-06T20:57:04.487ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118502024-12-06T20:57:04.491ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118512024-12-06T20:57:04.495ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978
118522024-12-06T20:57:04.498ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = UpdateNetworkConfig
118532024-12-06T20:57:04.498ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = UpdateNetworkConfig
118542024-12-06T20:57:04.506ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = UpdateNetworkConfig
118552024-12-06T20:57:04.506ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = UpdateNetworkConfig
118562024-12-06T20:57:04.510ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
118572024-12-06T20:57:04.510ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = UpdateNetworkConfig
118582024-12-06T20:57:04.511ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = UpdateNetworkConfig
118592024-12-06T20:57:04.512ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
118602024-12-06T20:57:04.512ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
118612024-12-06T20:57:04.513ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
118622024-12-06T20:57:04.514ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
118632024-12-06T20:57:04.515ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
118642024-12-06T20:57:04.515ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
118652024-12-06T20:57:04.515ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
118662024-12-06T20:57:04.519ZDEBGnexus: notifying dendrite of updates instance_id = Some(8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 (instance)) switch = switch0
118672024-12-06T20:57:04.520ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6954, tv_nsec: 861365472 } })
118682024-12-06T20:57:04.520ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
118692024-12-06T20:57:04.550ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
118702024-12-06T20:57:04.551ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118712024-12-06T20:57:04.551ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50d4ad84-9da0-491c-b8b9-dc194703cf66", "content-length": "26", "date": "Fri, 06 Dec 2024 20:57:04 GMT"} })
118722024-12-06T20:57:04.551ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118732024-12-06T20:57:04.552ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118742024-12-06T20:57:04.581ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
118752024-12-06T20:57:04.581ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4822fbd-3750-4f38-8c6a-789259718927", "content-length": "4", "date": "Fri, 06 Dec 2024 20:57:03 GMT"} })
118762024-12-06T20:57:04.582ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118772024-12-06T20:57:04.582ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118782024-12-06T20:57:04.586ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118792024-12-06T20:57:04.586ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118802024-12-06T20:57:04.594ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
118812024-12-06T20:57:04.595ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
118822024-12-06T20:57:04.632ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-06T20:57:04.621365Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, time_modified: Some(2024-12-06T20:57:04.621365Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: b8c9ca73-67e6-4aea-b6fc-902530f58ce8, time_modified: Some(2024-12-06T20:57:04.621365Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118832024-12-06T20:57:04.632ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118842024-12-06T20:57:04.632ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118852024-12-06T20:57:04.636ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118862024-12-06T20:57:04.636ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118872024-12-06T20:57:04.640ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118882024-12-06T20:57:04.640ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = UnassignOximeterProducer
118892024-12-06T20:57:04.640ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = UnassignOximeterProducer
118902024-12-06T20:57:04.644ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = bef145b4-2934-45c3-870a-63d45572bde4 producer_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118912024-12-06T20:57:04.644ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = UnassignOximeterProducer
118922024-12-06T20:57:04.645ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = UnassignOximeterProducer
118932024-12-06T20:57:04.683ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118942024-12-06T20:57:04.687ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/8e6b6db4-837f-4eb1-b0b2-b51d7f30c978
118952024-12-06T20:57:04.711ZDEBGnexus (SagaExecutor): client response oximeter-collector = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/8e6b6db4-837f-4eb1-b0b2-b51d7f30c978", status: 204, headers: {"x-request-id": "5f504004-be33-456d-b7db-6ac4254ac81c", "date": "Fri, 06 Dec 2024 20:57:04 GMT"} }) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118962024-12-06T20:57:04.711ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = bef145b4-2934-45c3-870a-63d45572bde4 producer_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
118972024-12-06T20:57:04.713ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
118982024-12-06T20:57:04.713ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
118992024-12-06T20:57:04.716ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119002024-12-06T20:57:04.716ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119012024-12-06T20:57:04.720ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 lock = UpdaterLock { updater_id: ca3159ca-75e8-40fe-aa89-de99dbfdf741, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-06T20:57:04.435123899Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
119022024-12-06T20:57:04.722ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = CommitInstanceUpdates
119032024-12-06T20:57:04.722ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = CommitInstanceUpdates
119042024-12-06T20:57:04.760ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 new_runtime = InstanceRuntimeState { time_updated: 2024-12-06T20:57:04.435123899Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
119052024-12-06T20:57:04.760ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119062024-12-06T20:57:04.760ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119072024-12-06T20:57:04.760ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
119082024-12-06T20:57:04.760ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
119092024-12-06T20:57:04.760ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Signaled
119102024-12-06T20:57:04.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119112024-12-06T20:57:04.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119122024-12-06T20:57:04.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119132024-12-06T20:57:04.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119142024-12-06T20:57:04.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119152024-12-06T20:57:04.764ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119162024-12-06T20:57:04.764ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119172024-12-06T20:57:04.764ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119182024-12-06T20:57:04.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119192024-12-06T20:57:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119202024-12-06T20:57:04.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119212024-12-06T20:57:04.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119222024-12-06T20:57:04.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119232024-12-06T20:57:04.767ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119242024-12-06T20:57:04.767ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("8e6b6db4-837f-4eb1-b0b2-b51d7f30c978"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("92607f49-ba1c-4ddf-87a1-60c0c155ce79")}) node_id = 7 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119252024-12-06T20:57:04.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119262024-12-06T20:57:04.773ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119272024-12-06T20:57:04.773ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119282024-12-06T20:57:04.779ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119292024-12-06T20:57:04.779ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119302024-12-06T20:57:04.783ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119312024-12-06T20:57:04.783ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119322024-12-06T20:57:04.791ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
119332024-12-06T20:57:04.791ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ReleaseSledResources
119342024-12-06T20:57:04.791ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ReleaseSledResources
119352024-12-06T20:57:04.796ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119362024-12-06T20:57:04.796ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119372024-12-06T20:57:04.800ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119382024-12-06T20:57:04.800ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119392024-12-06T20:57:04.804ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 propolis_id = 92607f49-ba1c-4ddf-87a1-60c0c155ce79 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
119402024-12-06T20:57:04.804ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = MarkVmmDeleted
119412024-12-06T20:57:04.804ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = MarkVmmDeleted
119422024-12-06T20:57:04.838ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119432024-12-06T20:57:04.838ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119442024-12-06T20:57:04.843ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119452024-12-06T20:57:04.843ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119462024-12-06T20:57:04.846ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119472024-12-06T20:57:04.846ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119482024-12-06T20:57:04.850ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119492024-12-06T20:57:04.850ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119502024-12-06T20:57:04.860ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
119512024-12-06T20:57:04.860ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119522024-12-06T20:57:04.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119532024-12-06T20:57:04.861ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbfef146-84d6-457a-b655-a12bde0f3fba", "content-length": "372", "date": "Fri, 06 Dec 2024 20:57:04 GMT"} })
119542024-12-06T20:57:04.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119552024-12-06T20:57:04.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119562024-12-06T20:57:04.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119572024-12-06T20:57:04.864ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ChainSuccessorSaga
119582024-12-06T20:57:04.865ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ChainSuccessorSaga
119592024-12-06T20:57:04.866ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ChainSuccessorSaga
119602024-12-06T20:57:04.866ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ChainSuccessorSaga
119612024-12-06T20:57:04.867ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ChainSuccessorSaga
119622024-12-06T20:57:04.867ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ChainSuccessorSaga
119632024-12-06T20:57:04.869ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ChainSuccessorSaga
119642024-12-06T20:57:04.872ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 435e56bf-fa70-439f-8ad1-7c07c9948190, lookup_type: ById(435e56bf-fa70-439f-8ad1-7c07c9948190) }, key: b8c9ca73-67e6-4aea-b6fc-902530f58ce8, lookup_type: ById(b8c9ca73-67e6-4aea-b6fc-902530f58ce8) }, key: 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978, lookup_type: ById(8e6b6db4-837f-4eb1-b0b2-b51d7f30c978) } result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ChainSuccessorSaga
119652024-12-06T20:57:04.872ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ChainSuccessorSaga
119662024-12-06T20:57:04.872ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_node = ChainSuccessorSaga
119672024-12-06T20:57:04.875ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
119682024-12-06T20:57:04.875ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
119692024-12-06T20:57:04.875ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a0ead83c-5124-4c1b-ac44-53e57b790b11", "date": "Fri, 06 Dec 2024 20:57:04 GMT"} })
119702024-12-06T20:57:04.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119712024-12-06T20:57:04.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119722024-12-06T20:57:04.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119732024-12-06T20:57:04.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119742024-12-06T20:57:04.877ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update
119752024-12-06T20:57:04.877ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119762024-12-06T20:57:04.877ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119772024-12-06T20:57:04.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119782024-12-06T20:57:04.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119792024-12-06T20:57:04.881ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119802024-12-06T20:57:04.881ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119812024-12-06T20:57:04.882ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
119822024-12-06T20:57:04.882ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119832024-12-06T20:57:04.882ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0b372581-57df-44cc-ac62-bbe6732b7c9a", "date": "Fri, 06 Dec 2024 20:57:04 GMT"} })
119842024-12-06T20:57:04.884ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119852024-12-06T20:57:04.884ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119862024-12-06T20:57:04.884ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 124.12558ms iteration = 27 status = {}
119872024-12-06T20:57:04.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7cdea093-daab-471c-803d-5d09ffc8e0f4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
119882024-12-06T20:57:04.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7cdea093-daab-471c-803d-5d09ffc8e0f4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
119892024-12-06T20:57:04.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7cdea093-daab-471c-803d-5d09ffc8e0f4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
119902024-12-06T20:57:04.888ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119912024-12-06T20:57:04.888ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68
119922024-12-06T20:57:04.926ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119932024-12-06T20:57:04.926ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 saga_name = instance-update saga_result = SagaResult { saga_id: 128879cc-750c-4816-a5ce-1daea48b5c68, saga_log: SagaLog { saga_id: 128879cc-750c-4816-a5ce-1daea48b5c68, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("ca3159ca-75e8-40fe-aa89-de99dbfdf741")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ca3159ca-75e8-40fe-aa89-de99dbfdf741")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("8e6b6db4-837f-4eb1-b0b2-b51d7f30c978"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("92607f49-ba1c-4ddf-87a1-60c0c155ce79")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("8e6b6db4-837f-4eb1-b0b2-b51d7f30c978"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("92607f49-ba1c-4ddf-87a1-60c0c155ce79")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("ca3159ca-75e8-40fe-aa89-de99dbfdf741"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("ca3159ca-75e8-40fe-aa89-de99dbfdf741")}} }) }
119942024-12-06T20:57:04.926ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 128879cc-750c-4816-a5ce-1daea48b5c68 instance_id = 8e6b6db4-837f-4eb1-b0b2-b51d7f30c978 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update
119952024-12-06T20:57:04.926ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119962024-12-06T20:57:04.926ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1
119972024-12-06T20:57:04.930ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
119982024-12-06T20:57:04.930ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1
119992024-12-06T20:57:04.934ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
120002024-12-06T20:57:04.934ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1
120012024-12-06T20:57:04.938ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
120022024-12-06T20:57:04.938ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1
120032024-12-06T20:57:04.944ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update sec_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
120042024-12-06T20:57:04.944ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = f08b49ca-f6cd-4651-8aee-282222bfb9b1 saga_name = start-instance-update saga_result = SagaResult { saga_id: f08b49ca-f6cd-4651-8aee-282222bfb9b1, saga_log: SagaLog { saga_id: f08b49ca-f6cd-4651-8aee-282222bfb9b1, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("11766e38-0b86-4217-a991-6d0e43a8daf6")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("11766e38-0b86-4217-a991-6d0e43a8daf6")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("11766e38-0b86-4217-a991-6d0e43a8daf6"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("11766e38-0b86-4217-a991-6d0e43a8daf6")}} }) }
120052024-12-06T20:57:04.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120062024-12-06T20:57:04.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120072024-12-06T20:57:04.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120082024-12-06T20:57:04.959ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120092024-12-06T20:57:04.959ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120102024-12-06T20:57:04.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120112024-12-06T20:57:04.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120122024-12-06T20:57:04.962ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120132024-12-06T20:57:04.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120142024-12-06T20:57:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120152024-12-06T20:57:04.996ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
120162024-12-06T20:57:04.996ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb2d1c38-49ae-443e-8ed2-20a397006008", "content-length": "691", "date": "Fri, 06 Dec 2024 20:57:04 GMT"} })
120172024-12-06T20:57:04.996ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
120182024-12-06T20:57:04.996ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
120192024-12-06T20:57:04.996ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
120202024-12-06T20:57:04.997ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 236.875946ms iteration = 27 status = {}
120212024-12-06T20:57:05.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b2377e51-49a8-48f1-b477-f95837e4a7bf roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120222024-12-06T20:57:05.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b2377e51-49a8-48f1-b477-f95837e4a7bf resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120232024-12-06T20:57:05.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b2377e51-49a8-48f1-b477-f95837e4a7bf response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120242024-12-06T20:57:06.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8f704536-a9ae-448b-8da4-68f96dc27f27 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120252024-12-06T20:57:06.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8f704536-a9ae-448b-8da4-68f96dc27f27 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120262024-12-06T20:57:06.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8f704536-a9ae-448b-8da4-68f96dc27f27 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120272024-12-06T20:57:07.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0bb81476-f80f-4642-9caf-042e615bee2c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120282024-12-06T20:57:07.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0bb81476-f80f-4642-9caf-042e615bee2c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120292024-12-06T20:57:07.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0bb81476-f80f-4642-9caf-042e615bee2c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120302024-12-06T20:57:08.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
120312024-12-06T20:57:08.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120322024-12-06T20:57:08.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
120332024-12-06T20:57:08.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120342024-12-06T20:57:08.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120352024-12-06T20:57:08.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120362024-12-06T20:57:08.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120372024-12-06T20:57:08.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120382024-12-06T20:57:08.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120392024-12-06T20:57:08.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120402024-12-06T20:57:08.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120412024-12-06T20:57:08.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120422024-12-06T20:57:08.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120432024-12-06T20:57:08.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120442024-12-06T20:57:08.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120452024-12-06T20:57:08.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
120462024-12-06T20:57:08.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120472024-12-06T20:57:08.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120482024-12-06T20:57:08.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
120492024-12-06T20:57:08.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.726422ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
120502024-12-06T20:57:08.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.893239ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120512024-12-06T20:57:08.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ceacc822-4a21-423e-9f4c-99cc9104a7da roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120522024-12-06T20:57:08.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ceacc822-4a21-423e-9f4c-99cc9104a7da resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120532024-12-06T20:57:08.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ceacc822-4a21-423e-9f4c-99cc9104a7da response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120542024-12-06T20:57:09.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e5b0b2f3-7b9b-4f22-90cb-4736cfe6e650 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120552024-12-06T20:57:09.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e5b0b2f3-7b9b-4f22-90cb-4736cfe6e650 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120562024-12-06T20:57:09.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e5b0b2f3-7b9b-4f22-90cb-4736cfe6e650 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120572024-12-06T20:57:11.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad6841eb-33b1-4d95-aff7-e58879dfc9fe roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120582024-12-06T20:57:11.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad6841eb-33b1-4d95-aff7-e58879dfc9fe resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120592024-12-06T20:57:11.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ad6841eb-33b1-4d95-aff7-e58879dfc9fe response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120602024-12-06T20:57:12.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc9b6da6-e6e8-4ce3-a713-7fc7b3044f5d roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120612024-12-06T20:57:12.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc9b6da6-e6e8-4ce3-a713-7fc7b3044f5d resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120622024-12-06T20:57:12.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc9b6da6-e6e8-4ce3-a713-7fc7b3044f5d response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120632024-12-06T20:57:12.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 643 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 44949a23-7961-4223-b54a-098dc2089ba4 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
120642024-12-06T20:57:13.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d2a3014-a418-4fdc-b319-44ba895ab90a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120652024-12-06T20:57:13.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d2a3014-a418-4fdc-b319-44ba895ab90a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120662024-12-06T20:57:13.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d2a3014-a418-4fdc-b319-44ba895ab90a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120672024-12-06T20:57:14.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f58a97e3-b46e-41b9-a610-6dc2b94d8cb7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120682024-12-06T20:57:14.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f58a97e3-b46e-41b9-a610-6dc2b94d8cb7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120692024-12-06T20:57:14.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f58a97e3-b46e-41b9-a610-6dc2b94d8cb7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120702024-12-06T20:57:15.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ec8ee017-8988-47c7-94dd-77826a56b65a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120712024-12-06T20:57:15.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ec8ee017-8988-47c7-94dd-77826a56b65a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120722024-12-06T20:57:15.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ec8ee017-8988-47c7-94dd-77826a56b65a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120732024-12-06T20:57:16.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc6bc3fb-38c1-4837-beaa-0ccf73bd66dd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120742024-12-06T20:57:16.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc6bc3fb-38c1-4837-beaa-0ccf73bd66dd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120752024-12-06T20:57:16.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fc6bc3fb-38c1-4837-beaa-0ccf73bd66dd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120762024-12-06T20:57:17.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05a97265-e136-48f1-989c-8ff2f285ebfa roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120772024-12-06T20:57:17.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05a97265-e136-48f1-989c-8ff2f285ebfa resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120782024-12-06T20:57:17.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 05a97265-e136-48f1-989c-8ff2f285ebfa response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120792024-12-06T20:57:18.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a839e227-7631-4363-b4ba-8230937e582b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120802024-12-06T20:57:18.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a839e227-7631-4363-b4ba-8230937e582b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120812024-12-06T20:57:18.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a839e227-7631-4363-b4ba-8230937e582b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
120822024-12-06T20:57:18.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
120832024-12-06T20:57:18.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
120842024-12-06T20:57:18.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120852024-12-06T20:57:18.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120862024-12-06T20:57:18.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120872024-12-06T20:57:18.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120882024-12-06T20:57:18.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120892024-12-06T20:57:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120902024-12-06T20:57:18.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120912024-12-06T20:57:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120922024-12-06T20:57:18.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120932024-12-06T20:57:18.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120942024-12-06T20:57:18.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120952024-12-06T20:57:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
120962024-12-06T20:57:18.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120972024-12-06T20:57:18.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120982024-12-06T20:57:18.871ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
120992024-12-06T20:57:18.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.13766ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
121002024-12-06T20:57:18.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121012024-12-06T20:57:18.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121022024-12-06T20:57:18.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.333097ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121032024-12-06T20:57:19.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e1307015-74cd-424a-8188-9c3617b89a3a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121042024-12-06T20:57:19.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e1307015-74cd-424a-8188-9c3617b89a3a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121052024-12-06T20:57:19.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e1307015-74cd-424a-8188-9c3617b89a3a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121062024-12-06T20:57:20.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e421b327-e4a4-47bd-8594-d8aaea9cff73 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121072024-12-06T20:57:20.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e421b327-e4a4-47bd-8594-d8aaea9cff73 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121082024-12-06T20:57:20.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = e421b327-e4a4-47bd-8594-d8aaea9cff73 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121092024-12-06T20:57:21.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 79b10dbe-e049-4721-96cb-0d7f5a300b7c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121102024-12-06T20:57:21.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 79b10dbe-e049-4721-96cb-0d7f5a300b7c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121112024-12-06T20:57:21.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 79b10dbe-e049-4721-96cb-0d7f5a300b7c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121122024-12-06T20:57:22.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fdfe7b81-5ffe-46db-9650-ddad83a49f15 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121132024-12-06T20:57:22.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fdfe7b81-5ffe-46db-9650-ddad83a49f15 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121142024-12-06T20:57:22.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fdfe7b81-5ffe-46db-9650-ddad83a49f15 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121152024-12-06T20:57:22.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 3f4d1c70-5496-405a-98a9-77e7334dea22 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
121162024-12-06T20:57:23.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0ae1280c-e11a-4f01-8ea6-fc2b03a5ab3c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121172024-12-06T20:57:23.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0ae1280c-e11a-4f01-8ea6-fc2b03a5ab3c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121182024-12-06T20:57:23.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0ae1280c-e11a-4f01-8ea6-fc2b03a5ab3c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121192024-12-06T20:57:24.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9f4c914e-9763-4f06-9682-563f5f788775 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121202024-12-06T20:57:24.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9f4c914e-9763-4f06-9682-563f5f788775 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121212024-12-06T20:57:24.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9f4c914e-9763-4f06-9682-563f5f788775 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121222024-12-06T20:57:25.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13b7b15a-b61c-4ded-b976-e7045c98ba36 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121232024-12-06T20:57:25.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13b7b15a-b61c-4ded-b976-e7045c98ba36 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121242024-12-06T20:57:25.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 13b7b15a-b61c-4ded-b976-e7045c98ba36 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121252024-12-06T20:57:26.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8fda333c-8fdd-4081-96f6-39ff1176ba4c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121262024-12-06T20:57:26.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8fda333c-8fdd-4081-96f6-39ff1176ba4c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121272024-12-06T20:57:26.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8fda333c-8fdd-4081-96f6-39ff1176ba4c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121282024-12-06T20:57:27.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7627e30e-2be7-4dd2-8587-c2ff95607cc6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121292024-12-06T20:57:27.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7627e30e-2be7-4dd2-8587-c2ff95607cc6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121302024-12-06T20:57:27.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7627e30e-2be7-4dd2-8587-c2ff95607cc6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121312024-12-06T20:57:28.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 78e5a207-14b0-45ca-9f72-29d4976e2c8e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121322024-12-06T20:57:28.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 78e5a207-14b0-45ca-9f72-29d4976e2c8e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121332024-12-06T20:57:28.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 78e5a207-14b0-45ca-9f72-29d4976e2c8e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
121342024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
121352024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
121362024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
121372024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
121382024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
121392024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121402024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
121412024-12-06T20:57:28.851ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-06 20:47:28.851322221 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
121422024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
121432024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
121442024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
121452024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121462024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
121472024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
121482024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
121492024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121502024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
121512024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
121522024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
121532024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
121542024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121552024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121562024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
121572024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121582024-12-06T20:57:28.851ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
121592024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
121602024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
121612024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
121622024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121632024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
121642024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
121652024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121662024-12-06T20:57:28.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
121672024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
121682024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
121692024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
121702024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
121712024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
121722024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
121732024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
121742024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
121752024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
121762024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121772024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
121782024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
121792024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
121802024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121812024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
121822024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
121832024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121842024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
121852024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
121862024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
121872024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
121882024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
121892024-12-06T20:57:28.852ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48
121902024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.421\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48"}
121912024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
121922024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
121932024-12-06T20:57:28.852ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
121942024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121952024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121962024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
121972024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
121982024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
121992024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122002024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
122012024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122022024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122032024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
122042024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
122052024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
122062024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122072024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122082024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122092024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122102024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122112024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122122024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
122132024-12-06T20:57:28.852ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0df5e14a-6e1e-4dcd-bf05-d67f92d30034.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2372a96e-6bc5-4e12-9310-7e2f7c4121e7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0d51dc5-eec8-4f23-825b-ece452653cf1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 6979, tv_nsec: 193742359 } })
122142024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122152024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122162024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
122172024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122182024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
122192024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122202024-12-06T20:57:28.852ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("59b92633-3550-4af1-b628-503b6bafd00d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9d99eda0-389f-44c6-94ee-e9e7a03c9733.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 6979, tv_nsec: 193827251 } })
122212024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
122222024-12-06T20:57:28.852ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
122232024-12-06T20:57:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.708754ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
122242024-12-06T20:57:28.853ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
122252024-12-06T20:57:28.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.673493ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
122262024-12-06T20:57:28.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6979, tv_nsec: 195879594 } })
122272024-12-06T20:57:28.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122282024-12-06T20:57:28.854ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
122292024-12-06T20:57:28.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122302024-12-06T20:57:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122312024-12-06T20:57:28.856ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-06 20:47:28.851322221 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
122322024-12-06T20:57:28.856ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.747142ms iteration = 14 status = {"expiration":"2024-12-06T20:47:28.851322221Z","pruned":[]}
122332024-12-06T20:57:28.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
122342024-12-06T20:57:28.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122352024-12-06T20:57:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122362024-12-06T20:57:28.857ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.357568ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
122372024-12-06T20:57:28.857ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
122382024-12-06T20:57:28.857ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
122392024-12-06T20:57:28.857ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.145758ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
122402024-12-06T20:57:28.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122412024-12-06T20:57:28.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122422024-12-06T20:57:28.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6979, tv_nsec: 201518479 } })
122432024-12-06T20:57:28.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
122442024-12-06T20:57:28.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122452024-12-06T20:57:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122462024-12-06T20:57:28.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122472024-12-06T20:57:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122482024-12-06T20:57:28.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122492024-12-06T20:57:28.869ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.469971ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
122502024-12-06T20:57:28.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122512024-12-06T20:57:28.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122522024-12-06T20:57:28.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122532024-12-06T20:57:28.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122542024-12-06T20:57:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
122552024-12-06T20:57:28.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122562024-12-06T20:57:28.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122572024-12-06T20:57:28.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122582024-12-06T20:57:28.880ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122592024-12-06T20:57:28.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122602024-12-06T20:57:28.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122612024-12-06T20:57:28.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122622024-12-06T20:57:28.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122632024-12-06T20:57:28.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122642024-12-06T20:57:28.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122652024-12-06T20:57:28.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122662024-12-06T20:57:28.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122672024-12-06T20:57:28.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122682024-12-06T20:57:28.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
122692024-12-06T20:57:28.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122702024-12-06T20:57:28.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
122712024-12-06T20:57:28.913ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122722024-12-06T20:57:28.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122732024-12-06T20:57:28.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122742024-12-06T20:57:28.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122752024-12-06T20:57:28.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
122762024-12-06T20:57:28.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122772024-12-06T20:57:28.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122782024-12-06T20:57:28.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.572725ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
122792024-12-06T20:57:28.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122802024-12-06T20:57:28.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122812024-12-06T20:57:28.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122822024-12-06T20:57:28.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122832024-12-06T20:57:28.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
122842024-12-06T20:57:28.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122852024-12-06T20:57:28.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
122862024-12-06T20:57:28.934ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122872024-12-06T20:57:28.934ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
122882024-12-06T20:57:28.934ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122892024-12-06T20:57:28.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122902024-12-06T20:57:28.934ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122912024-12-06T20:57:28.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122922024-12-06T20:57:28.937ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122932024-12-06T20:57:28.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122942024-12-06T20:57:28.938ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122952024-12-06T20:57:28.938ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 6979, tv_nsec: 280247969 } })
122962024-12-06T20:57:28.939ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122972024-12-06T20:57:28.939ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
122982024-12-06T20:57:28.939ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
122992024-12-06T20:57:28.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123002024-12-06T20:57:28.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
123012024-12-06T20:57:28.940ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123022024-12-06T20:57:28.940ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
123032024-12-06T20:57:28.940ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123042024-12-06T20:57:28.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123052024-12-06T20:57:28.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.185739ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123062024-12-06T20:57:28.941ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123072024-12-06T20:57:28.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
123082024-12-06T20:57:28.942ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
123092024-12-06T20:57:28.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
123102024-12-06T20:57:28.942ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 91.1712ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
123112024-12-06T20:57:28.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123122024-12-06T20:57:28.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123132024-12-06T20:57:28.945ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123142024-12-06T20:57:28.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123152024-12-06T20:57:28.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
123162024-12-06T20:57:28.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123172024-12-06T20:57:28.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
123182024-12-06T20:57:28.955ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
123192024-12-06T20:57:28.955ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 103.899429ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
123202024-12-06T20:57:28.955ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123212024-12-06T20:57:28.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
123222024-12-06T20:57:28.959ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123232024-12-06T20:57:28.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123242024-12-06T20:57:28.972ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
123252024-12-06T20:57:28.972ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
123262024-12-06T20:57:28.973ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e76fd5c-8315-4421-b98f-731b4a000e92", "content-length": "26", "date": "Fri, 06 Dec 2024 20:57:28 GMT"} })
123272024-12-06T20:57:28.973ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
123282024-12-06T20:57:28.976ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
123292024-12-06T20:57:28.980ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
123302024-12-06T20:57:28.982ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123312024-12-06T20:57:28.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123322024-12-06T20:57:28.985ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123332024-12-06T20:57:28.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123342024-12-06T20:57:28.987ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123352024-12-06T20:57:28.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
123362024-12-06T20:57:28.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
123372024-12-06T20:57:28.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
123382024-12-06T20:57:28.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123392024-12-06T20:57:28.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123402024-12-06T20:57:28.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 141.726604ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
123412024-12-06T20:57:28.994ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
123422024-12-06T20:57:28.994ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 143.179851ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
123432024-12-06T20:57:28.995ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123442024-12-06T20:57:28.995ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 143.791487ms iteration = 27 status = 0
123452024-12-06T20:57:28.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123462024-12-06T20:57:28.999ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123472024-12-06T20:57:28.999ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
123482024-12-06T20:57:28.999ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.592835ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
123492024-12-06T20:57:29.000ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 149.059763ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123502024-12-06T20:57:29.001ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
123512024-12-06T20:57:29.001ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
123522024-12-06T20:57:29.001ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
123532024-12-06T20:57:29.001ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123542024-12-06T20:57:29.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123552024-12-06T20:57:29.002ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
123562024-12-06T20:57:29.002ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
123572024-12-06T20:57:29.002ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 150.827689ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
123582024-12-06T20:57:29.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123592024-12-06T20:57:29.005ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
123602024-12-06T20:57:29.005ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
123612024-12-06T20:57:29.005ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
123622024-12-06T20:57:29.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123632024-12-06T20:57:29.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123642024-12-06T20:57:29.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
123652024-12-06T20:57:29.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123662024-12-06T20:57:29.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123672024-12-06T20:57:29.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123682024-12-06T20:57:29.009ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
123692024-12-06T20:57:29.009ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 0 version = 2
123702024-12-06T20:57:29.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123712024-12-06T20:57:29.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123722024-12-06T20:57:29.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123732024-12-06T20:57:29.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
123742024-12-06T20:57:29.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123752024-12-06T20:57:29.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123762024-12-06T20:57:29.011ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123772024-12-06T20:57:29.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123782024-12-06T20:57:29.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
123792024-12-06T20:57:29.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123802024-12-06T20:57:29.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123812024-12-06T20:57:29.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 183.941112ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
123822024-12-06T20:57:29.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123832024-12-06T20:57:29.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123842024-12-06T20:57:29.080ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.939732ms iteration = 30 status = {"physical_disks_added":0}
123852024-12-06T20:57:29.100ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
123862024-12-06T20:57:29.100ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 249.335778ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
123872024-12-06T20:57:29.139ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 288.21219ms iteration = 27 status = {}
123882024-12-06T20:57:29.151ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
123892024-12-06T20:57:29.172ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
123902024-12-06T20:57:29.172ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123912024-12-06T20:57:29.172ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "05cb28e3-dea6-4d46-b7b4-601032419875", "content-length": "372", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} })
123922024-12-06T20:57:29.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123932024-12-06T20:57:29.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123942024-12-06T20:57:29.174ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
123952024-12-06T20:57:29.174ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
123962024-12-06T20:57:29.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123972024-12-06T20:57:29.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123982024-12-06T20:57:29.174ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123992024-12-06T20:57:29.175ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f8dbcae1-2cf9-4ea7-b984-ec138f004834 dns_zone_name = oxide.test found_so_far = 1 version = 2
124002024-12-06T20:57:29.175ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
124012024-12-06T20:57:29.175ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-06 20:44:32.434459 UTC dns_group = external generation = 2
124022024-12-06T20:57:29.175ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 324.215859ms iteration = 14 status = {"generation":2}
124032024-12-06T20:57:29.176ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
124042024-12-06T20:57:29.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
124052024-12-06T20:57:29.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
124062024-12-06T20:57:29.182ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124072024-12-06T20:57:29.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124082024-12-06T20:57:29.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124092024-12-06T20:57:29.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124102024-12-06T20:57:29.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124112024-12-06T20:57:29.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124122024-12-06T20:57:29.187ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
124132024-12-06T20:57:29.187ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
124142024-12-06T20:57:29.187ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4035fd78-2101-4165-8a28-0852e3921e87", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} })
124152024-12-06T20:57:29.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124162024-12-06T20:57:29.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124172024-12-06T20:57:29.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124182024-12-06T20:57:29.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124192024-12-06T20:57:29.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124202024-12-06T20:57:29.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124212024-12-06T20:57:29.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124222024-12-06T20:57:29.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124232024-12-06T20:57:29.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124242024-12-06T20:57:29.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124252024-12-06T20:57:29.197ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124262024-12-06T20:57:29.197ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124272024-12-06T20:57:29.197ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c6836419-98ba-448e-8381-58339a711f92", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} })
124282024-12-06T20:57:29.199ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 347.317194ms iteration = 28 status = {}
124292024-12-06T20:57:29.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124302024-12-06T20:57:29.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
124312024-12-06T20:57:29.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
124322024-12-06T20:57:29.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
124332024-12-06T20:57:29.214ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2a822af2-b473-48ea-9e47-72d3f9f29e3e dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
124342024-12-06T20:57:29.214ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
124352024-12-06T20:57:29.214ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-06 20:44:30.938580 UTC dns_group = internal generation = 1
124362024-12-06T20:57:29.214ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 362.839854ms iteration = 14 status = {"generation":1}
124372024-12-06T20:57:29.214ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-06T20:44:26.194685Z, time_modified: 2024-12-06T20:44:26.194685Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 435e56bf-fa70-439f-8ad1-7c07c9948190, db_silo: Silo { identity: SiloIdentity { id: 435e56bf-fa70-439f-8ad1-7c07c9948190, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-06T20:44:32.362160Z, time_modified: 2024-12-06T20:44:32.362160Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
124382024-12-06T20:57:29.214ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 363.481121ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]}},"default_endpoint":{"silo_id":"435e56bf-fa70-439f-8ad1-7c07c9948190","tls_certs":["583f91f165cb1e63b66ad6f1654618531208b2fc5c6d89045f5ebce26db11eed"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
124392024-12-06T20:57:29.227ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
124402024-12-06T20:57:29.227ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124412024-12-06T20:57:29.227ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef0875d3-b725-4d34-be1f-6ed9a0488a38", "content-length": "26", "date": "Fri, 06 Dec 2024 20:57:28 GMT"} })
124422024-12-06T20:57:29.227ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124432024-12-06T20:57:29.233ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124442024-12-06T20:57:29.248ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
124452024-12-06T20:57:29.248ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
124462024-12-06T20:57:29.248ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124472024-12-06T20:57:29.248ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe3698cd-4064-445e-84af-5b05c3b8bb8d", "content-length": "26", "date": "Fri, 06 Dec 2024 20:57:28 GMT"} })
124482024-12-06T20:57:29.248ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124492024-12-06T20:57:29.251ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
124502024-12-06T20:57:29.280ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
124512024-12-06T20:57:29.281ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "18adb6ef-361d-4c7f-9057-c167a15dbbd9", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
124522024-12-06T20:57:29.281ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
124532024-12-06T20:57:29.282ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1d8e81c0-c135-4b19-b73c-9fa3056ca556", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
124542024-12-06T20:57:29.282ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
124552024-12-06T20:57:29.284ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1286c602-4383-4abe-a109-54cb17f6acb6", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
124562024-12-06T20:57:29.284ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
124572024-12-06T20:57:29.286ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
124582024-12-06T20:57:29.286ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 435.230271ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
124592024-12-06T20:57:29.355ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
124602024-12-06T20:57:29.355ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f549893-9423-47a0-9f7e-23aeee9811c6", "content-length": "2", "date": "Fri, 06 Dec 2024 20:57:28 GMT"} })
124612024-12-06T20:57:29.356ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
124622024-12-06T20:57:29.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
124632024-12-06T20:57:29.359ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 507.783271ms iteration = 27 status = null
124642024-12-06T20:57:29.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1a6d04c6-6bd3-493f-813f-b58f2ceb1896 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
124652024-12-06T20:57:29.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1a6d04c6-6bd3-493f-813f-b58f2ceb1896 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
124662024-12-06T20:57:29.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1739 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1a6d04c6-6bd3-493f-813f-b58f2ceb1896 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
124672024-12-06T20:57:29.564ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
124682024-12-06T20:57:29.564ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
124692024-12-06T20:57:29.564ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ed455384-078e-493b-bda0-20e0bfbfb6c6", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
124702024-12-06T20:57:29.564ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
124712024-12-06T20:57:29.564ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "60135517-7eef-4dbd-9db7-adf36cf2fef6", "content-length": "691", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} })
124722024-12-06T20:57:29.564ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
124732024-12-06T20:57:29.564ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
124742024-12-06T20:57:29.564ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
124752024-12-06T20:57:29.566ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 714.916771ms iteration = 28 status = {}
124762024-12-06T20:57:29.566ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b72a14f9-6d7c-4ba9-82db-cb0a1d97b1cd", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
124772024-12-06T20:57:29.566ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
124782024-12-06T20:57:29.568ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
124792024-12-06T20:57:29.568ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 717.58573ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
124802024-12-06T20:57:29.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124812024-12-06T20:57:29.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124822024-12-06T20:57:29.628ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
124832024-12-06T20:57:29.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124842024-12-06T20:57:29.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124852024-12-06T20:57:29.639ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
124862024-12-06T20:57:29.639ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa38ed53-389c-495b-b97b-e0ba7d1f8264", "content-length": "134", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} })
124872024-12-06T20:57:29.639ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
124882024-12-06T20:57:29.639ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
124892024-12-06T20:57:29.639ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
124902024-12-06T20:57:29.639ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
124912024-12-06T20:57:29.639ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124922024-12-06T20:57:29.639ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124932024-12-06T20:57:29.639ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124942024-12-06T20:57:29.639ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124952024-12-06T20:57:29.639ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124962024-12-06T20:57:29.639ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124972024-12-06T20:57:29.639ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
124982024-12-06T20:57:29.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124992024-12-06T20:57:29.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125002024-12-06T20:57:29.641ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
125012024-12-06T20:57:29.641ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "322c86fd-5f9a-4990-b60d-132bcb10666e", "content-length": "2", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} })
125022024-12-06T20:57:29.641ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
125032024-12-06T20:57:29.641ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9347618-ba1c-496c-a13d-f1ef6be24364", "content-length": "52", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} })
125042024-12-06T20:57:29.641ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
125052024-12-06T20:57:29.641ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
125062024-12-06T20:57:29.723ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "14cf6c88-8471-4eeb-906f-07e03cb90f5d", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} })
125072024-12-06T20:57:29.723ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
125082024-12-06T20:57:29.723ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
125092024-12-06T20:57:29.723ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b43abbca-b3a0-45d4-a6c3-9aa70a3fdb1e", "content-length": "682", "date": "Fri, 06 Dec 2024 20:57:29 GMT"} })
125102024-12-06T20:57:29.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125112024-12-06T20:57:29.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125122024-12-06T20:57:29.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125132024-12-06T20:57:29.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125142024-12-06T20:57:29.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125152024-12-06T20:57:29.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125162024-12-06T20:57:29.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125172024-12-06T20:57:29.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125182024-12-06T20:57:29.740ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 889.358538ms iteration = 27 status = {}
125192024-12-06T20:57:30.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e74a517-9e01-4276-91ec-be0e490feccb roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125202024-12-06T20:57:30.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e74a517-9e01-4276-91ec-be0e490feccb resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125212024-12-06T20:57:30.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9e74a517-9e01-4276-91ec-be0e490feccb response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125222024-12-06T20:57:31.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b793aaa-d7e5-490a-989e-8b12c1dbbf8c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125232024-12-06T20:57:31.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b793aaa-d7e5-490a-989e-8b12c1dbbf8c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125242024-12-06T20:57:31.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b793aaa-d7e5-490a-989e-8b12c1dbbf8c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125252024-12-06T20:57:32.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 599 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = ddb668a1-1026-408d-84c4-e9cb74177dcd response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
125262024-12-06T20:57:32.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d24c7bc6-b5cf-43a9-b497-2d7fe5aef96e roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125272024-12-06T20:57:32.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d24c7bc6-b5cf-43a9-b497-2d7fe5aef96e resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125282024-12-06T20:57:32.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d24c7bc6-b5cf-43a9-b497-2d7fe5aef96e response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125292024-12-06T20:57:33.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 557e3b17-5eae-4e12-b8e9-2411b33d86db roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125302024-12-06T20:57:33.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 557e3b17-5eae-4e12-b8e9-2411b33d86db resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125312024-12-06T20:57:33.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 557e3b17-5eae-4e12-b8e9-2411b33d86db response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125322024-12-06T20:57:34.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ef5d7b13-ac4f-4df3-8dc3-12b33513fe86 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125332024-12-06T20:57:34.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ef5d7b13-ac4f-4df3-8dc3-12b33513fe86 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125342024-12-06T20:57:34.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ef5d7b13-ac4f-4df3-8dc3-12b33513fe86 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125352024-12-06T20:57:35.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d97890b-9081-4649-9427-3f86a56086fa roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125362024-12-06T20:57:35.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d97890b-9081-4649-9427-3f86a56086fa resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125372024-12-06T20:57:35.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2d97890b-9081-4649-9427-3f86a56086fa response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125382024-12-06T20:57:36.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 12719f9a-9034-48ba-9f3c-900345bd668a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125392024-12-06T20:57:36.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 12719f9a-9034-48ba-9f3c-900345bd668a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125402024-12-06T20:57:36.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 12719f9a-9034-48ba-9f3c-900345bd668a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125412024-12-06T20:57:37.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = efc6adfe-956d-4324-b958-064dd6a07879 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125422024-12-06T20:57:37.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = efc6adfe-956d-4324-b958-064dd6a07879 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125432024-12-06T20:57:37.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = efc6adfe-956d-4324-b958-064dd6a07879 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125442024-12-06T20:57:38.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fa0636e3-b5aa-4db0-81c8-6e7cdf324ebe roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125452024-12-06T20:57:38.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fa0636e3-b5aa-4db0-81c8-6e7cdf324ebe resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125462024-12-06T20:57:38.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = fa0636e3-b5aa-4db0-81c8-6e7cdf324ebe response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125472024-12-06T20:57:38.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
125482024-12-06T20:57:38.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
125492024-12-06T20:57:38.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125502024-12-06T20:57:38.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125512024-12-06T20:57:38.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125522024-12-06T20:57:38.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125532024-12-06T20:57:38.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125542024-12-06T20:57:38.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125552024-12-06T20:57:38.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125562024-12-06T20:57:38.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.463785ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125572024-12-06T20:57:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125582024-12-06T20:57:38.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125592024-12-06T20:57:38.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125602024-12-06T20:57:38.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125612024-12-06T20:57:38.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125622024-12-06T20:57:38.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125632024-12-06T20:57:38.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
125642024-12-06T20:57:38.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125652024-12-06T20:57:38.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125662024-12-06T20:57:38.873ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
125672024-12-06T20:57:38.873ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.760991ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
125682024-12-06T20:57:39.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc92cd83-802a-4627-bb19-52ea444aba62 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125692024-12-06T20:57:39.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc92cd83-802a-4627-bb19-52ea444aba62 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125702024-12-06T20:57:39.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bc92cd83-802a-4627-bb19-52ea444aba62 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125712024-12-06T20:57:40.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c4841a3-6ef2-4555-9fef-c3e530fe87d0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125722024-12-06T20:57:40.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c4841a3-6ef2-4555-9fef-c3e530fe87d0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125732024-12-06T20:57:40.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 6c4841a3-6ef2-4555-9fef-c3e530fe87d0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125742024-12-06T20:57:41.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0d0a484d-028e-440a-954e-5e43559e9121 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125752024-12-06T20:57:41.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0d0a484d-028e-440a-954e-5e43559e9121 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125762024-12-06T20:57:41.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 0d0a484d-028e-440a-954e-5e43559e9121 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125772024-12-06T20:57:42.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 30beffb1-a655-4add-9dc2-14ea309fe25a response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
125782024-12-06T20:57:42.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8037ed79-b975-43bf-bad3-30e5f316e057 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125792024-12-06T20:57:42.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8037ed79-b975-43bf-bad3-30e5f316e057 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125802024-12-06T20:57:42.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8037ed79-b975-43bf-bad3-30e5f316e057 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125812024-12-06T20:57:43.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d4bf628-c45b-43f8-8885-43055f255f78 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125822024-12-06T20:57:43.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d4bf628-c45b-43f8-8885-43055f255f78 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125832024-12-06T20:57:43.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1d4bf628-c45b-43f8-8885-43055f255f78 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125842024-12-06T20:57:44.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dc531904-b243-49f4-8dc0-f6088eeb7999 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125852024-12-06T20:57:44.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dc531904-b243-49f4-8dc0-f6088eeb7999 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125862024-12-06T20:57:44.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = dc531904-b243-49f4-8dc0-f6088eeb7999 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125872024-12-06T20:57:45.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 358ad51f-2cbf-4298-b8fc-cc26e29c0fa2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125882024-12-06T20:57:45.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 358ad51f-2cbf-4298-b8fc-cc26e29c0fa2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125892024-12-06T20:57:45.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 358ad51f-2cbf-4298-b8fc-cc26e29c0fa2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125902024-12-06T20:57:46.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f15b6119-ed61-4ce1-af9f-18332f2c8a76 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125912024-12-06T20:57:46.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f15b6119-ed61-4ce1-af9f-18332f2c8a76 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125922024-12-06T20:57:46.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f15b6119-ed61-4ce1-af9f-18332f2c8a76 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125932024-12-06T20:57:47.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b5b3d5cf-d734-4aeb-9abb-30c2e33a0d7a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125942024-12-06T20:57:47.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b5b3d5cf-d734-4aeb-9abb-30c2e33a0d7a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125952024-12-06T20:57:47.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b5b3d5cf-d734-4aeb-9abb-30c2e33a0d7a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125962024-12-06T20:57:48.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab444bf1-dd27-403a-9e6f-d266addfd0a3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125972024-12-06T20:57:48.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab444bf1-dd27-403a-9e6f-d266addfd0a3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125982024-12-06T20:57:48.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ab444bf1-dd27-403a-9e6f-d266addfd0a3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
125992024-12-06T20:57:48.852ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
126002024-12-06T20:57:48.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
126012024-12-06T20:57:48.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126022024-12-06T20:57:48.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126032024-12-06T20:57:48.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126042024-12-06T20:57:48.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126052024-12-06T20:57:48.854ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126062024-12-06T20:57:48.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126072024-12-06T20:57:48.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126082024-12-06T20:57:48.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126092024-12-06T20:57:48.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126102024-12-06T20:57:48.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126112024-12-06T20:57:48.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126122024-12-06T20:57:48.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126132024-12-06T20:57:48.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126142024-12-06T20:57:48.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
126152024-12-06T20:57:48.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126162024-12-06T20:57:48.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126172024-12-06T20:57:48.875ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
126182024-12-06T20:57:48.875ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.016104ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
126192024-12-06T20:57:48.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.041054ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126202024-12-06T20:57:49.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 847b6751-0538-4335-99c4-11000614d62c roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126212024-12-06T20:57:49.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 847b6751-0538-4335-99c4-11000614d62c resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126222024-12-06T20:57:49.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 847b6751-0538-4335-99c4-11000614d62c response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126232024-12-06T20:57:50.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d3f31ee7-a7db-435e-ab07-6dcde1cf166a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126242024-12-06T20:57:50.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d3f31ee7-a7db-435e-ab07-6dcde1cf166a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126252024-12-06T20:57:50.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = d3f31ee7-a7db-435e-ab07-6dcde1cf166a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126262024-12-06T20:57:51.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ec26dff2-2d35-4220-bdea-ded3255a28c2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126272024-12-06T20:57:51.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ec26dff2-2d35-4220-bdea-ded3255a28c2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126282024-12-06T20:57:51.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ec26dff2-2d35-4220-bdea-ded3255a28c2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126292024-12-06T20:57:52.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 636 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 299de8f4-258d-4a9d-8d17-848bf3479fb4 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
126302024-12-06T20:57:52.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 92cf6d80-14ec-4d0f-8060-071a819ae0bd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126312024-12-06T20:57:52.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 92cf6d80-14ec-4d0f-8060-071a819ae0bd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126322024-12-06T20:57:52.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 92cf6d80-14ec-4d0f-8060-071a819ae0bd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126332024-12-06T20:57:53.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea82a61c-ee6b-4770-9552-3eff659b4a5b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126342024-12-06T20:57:53.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea82a61c-ee6b-4770-9552-3eff659b4a5b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126352024-12-06T20:57:53.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = ea82a61c-ee6b-4770-9552-3eff659b4a5b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126362024-12-06T20:57:54.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 27e1879b-4749-4a98-b378-d8348a80a8fa roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126372024-12-06T20:57:54.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 27e1879b-4749-4a98-b378-d8348a80a8fa resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126382024-12-06T20:57:54.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 27e1879b-4749-4a98-b378-d8348a80a8fa response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126392024-12-06T20:57:55.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e52950f-7a39-41c6-a32a-535230072bbd roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126402024-12-06T20:57:55.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e52950f-7a39-41c6-a32a-535230072bbd resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126412024-12-06T20:57:55.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5e52950f-7a39-41c6-a32a-535230072bbd response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126422024-12-06T20:57:56.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8b493e05-8626-49ae-aa69-58ca687d57d6 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126432024-12-06T20:57:56.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8b493e05-8626-49ae-aa69-58ca687d57d6 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126442024-12-06T20:57:56.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8b493e05-8626-49ae-aa69-58ca687d57d6 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126452024-12-06T20:57:58.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2fa5791c-ee5e-455d-bdc0-732f33668ccf roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126462024-12-06T20:57:58.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2fa5791c-ee5e-455d-bdc0-732f33668ccf resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126472024-12-06T20:57:58.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2fa5791c-ee5e-455d-bdc0-732f33668ccf response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
126482024-12-06T20:57:58.850ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
126492024-12-06T20:57:58.850ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
126502024-12-06T20:57:58.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
126512024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
126522024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126532024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
126542024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
126552024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
126562024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
126572024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
126582024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
126592024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
126602024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
126612024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
126622024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
126632024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
126642024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
126652024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126662024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
126672024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126682024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
126692024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
126702024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
126712024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
126722024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
126732024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
126742024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
126752024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
126762024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
126772024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
126782024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126792024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
126802024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
126812024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
126822024-12-06T20:57:58.851ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
126832024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126842024-12-06T20:57:58.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126852024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
126862024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
126872024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
126882024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
126892024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126902024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
126912024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
126922024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
126932024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126942024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
126952024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126962024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
126972024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126982024-12-06T20:57:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
126992024-12-06T20:57:58.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 7009, tv_nsec: 195199265 } })
127002024-12-06T20:57:58.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127012024-12-06T20:57:58.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
127022024-12-06T20:57:58.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127032024-12-06T20:57:58.854ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.448809ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
127042024-12-06T20:57:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
127052024-12-06T20:57:58.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127062024-12-06T20:57:58.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127072024-12-06T20:57:58.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
127082024-12-06T20:57:58.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127092024-12-06T20:57:58.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127102024-12-06T20:57:58.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127112024-12-06T20:57:58.861ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127122024-12-06T20:57:58.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127132024-12-06T20:57:58.862ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127142024-12-06T20:57:58.862ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
127152024-12-06T20:57:58.862ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127162024-12-06T20:57:58.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127172024-12-06T20:57:58.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127182024-12-06T20:57:58.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127192024-12-06T20:57:58.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127202024-12-06T20:57:58.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
127212024-12-06T20:57:58.864ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127222024-12-06T20:57:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127232024-12-06T20:57:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
127242024-12-06T20:57:58.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
127252024-12-06T20:57:58.865ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 7009, tv_nsec: 207168374 } })
127262024-12-06T20:57:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127272024-12-06T20:57:58.865ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
127282024-12-06T20:57:58.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127292024-12-06T20:57:58.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127302024-12-06T20:57:58.868ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-0a667526-2006-419e-9b68-c251fd138c06.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 7009, tv_nsec: 209826572 } })
127312024-12-06T20:57:58.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127322024-12-06T20:57:58.868ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
127332024-12-06T20:57:58.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127342024-12-06T20:57:58.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127352024-12-06T20:57:58.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
127362024-12-06T20:57:58.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127372024-12-06T20:57:58.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127382024-12-06T20:57:58.875ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
127392024-12-06T20:57:58.875ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.425024ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
127402024-12-06T20:57:58.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127412024-12-06T20:57:58.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
127422024-12-06T20:57:58.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127432024-12-06T20:57:58.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127442024-12-06T20:57:58.910ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
127452024-12-06T20:57:58.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
127462024-12-06T20:57:58.910ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127472024-12-06T20:57:58.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127482024-12-06T20:57:58.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.990224ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
127492024-12-06T20:57:58.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.438552ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
127502024-12-06T20:57:58.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127512024-12-06T20:57:58.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127522024-12-06T20:57:58.919ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127532024-12-06T20:57:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127542024-12-06T20:57:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127552024-12-06T20:57:58.920ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
127562024-12-06T20:57:58.920ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
127572024-12-06T20:57:58.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127582024-12-06T20:57:58.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127592024-12-06T20:57:58.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127602024-12-06T20:57:58.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127612024-12-06T20:57:58.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127622024-12-06T20:57:58.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127632024-12-06T20:57:58.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127642024-12-06T20:57:58.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127652024-12-06T20:57:58.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127662024-12-06T20:57:58.934ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
127672024-12-06T20:57:58.934ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
127682024-12-06T20:57:58.934ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f5e6984-5c72-42d0-b8c5-93158562a741", "content-length": "26", "date": "Fri, 06 Dec 2024 20:57:58 GMT"} })
127692024-12-06T20:57:58.935ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
127702024-12-06T20:57:58.937ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
127712024-12-06T20:57:58.946ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127722024-12-06T20:57:58.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
127732024-12-06T20:57:58.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.616309ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
127742024-12-06T20:57:58.971ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 zone_address = fd00:1122:3344:101::2
127752024-12-06T20:57:58.971ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
127762024-12-06T20:57:58.971ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22c4c486-66e2-485a-845b-6471d55e5ab1", "content-length": "26", "date": "Fri, 06 Dec 2024 20:57:58 GMT"} })
127772024-12-06T20:57:58.971ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
127782024-12-06T20:57:58.973ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
127792024-12-06T20:57:58.973ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
127802024-12-06T20:57:58.973ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
127812024-12-06T20:57:58.973ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "477faf34-3389-4682-9f6b-ecb5ff034f10", "content-length": "26", "date": "Fri, 06 Dec 2024 20:57:58 GMT"} })
127822024-12-06T20:57:58.973ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
127832024-12-06T20:57:58.975ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
127842024-12-06T20:57:58.997ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 145.632074ms iteration = 31 status = {"physical_disks_added":0}
127852024-12-06T20:57:59.006ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
127862024-12-06T20:57:59.006ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
127872024-12-06T20:57:59.006ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdcd6c20-56da-425c-a255-9374f7a6de01", "content-length": "372", "date": "Fri, 06 Dec 2024 20:57:59 GMT"} })
127882024-12-06T20:57:59.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127892024-12-06T20:57:59.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127902024-12-06T20:57:59.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 156.475544ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
127912024-12-06T20:57:59.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127922024-12-06T20:57:59.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127932024-12-06T20:57:59.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127942024-12-06T20:57:59.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127952024-12-06T20:57:59.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127962024-12-06T20:57:59.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
127972024-12-06T20:57:59.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127982024-12-06T20:57:59.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127992024-12-06T20:57:59.027ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
128002024-12-06T20:57:59.027ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e738f35-ff06-4aa9-ba58-201f7e78bcaa", "content-length": "2", "date": "Fri, 06 Dec 2024 20:57:58 GMT"} })
128012024-12-06T20:57:59.029ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
128022024-12-06T20:57:59.029ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 177.468145ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
128032024-12-06T20:57:59.029ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
128042024-12-06T20:57:59.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
128052024-12-06T20:57:59.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2fabb0e1-cf00-498e-b4e1-0c1876149f93 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
128062024-12-06T20:57:59.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2fabb0e1-cf00-498e-b4e1-0c1876149f93 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
128072024-12-06T20:57:59.031ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 181.13995ms iteration = 28 status = null
128082024-12-06T20:57:59.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2fabb0e1-cf00-498e-b4e1-0c1876149f93 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
128092024-12-06T20:57:59.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 188.382727ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
128102024-12-06T20:57:59.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128112024-12-06T20:57:59.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 192.278937ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
128122024-12-06T20:57:59.045ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128132024-12-06T20:57:59.045ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
128142024-12-06T20:57:59.045ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 193.56575ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
128152024-12-06T20:57:59.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 0a667526-2006-419e-9b68-c251fd138c06, lookup_type: ById(0a667526-2006-419e-9b68-c251fd138c06) } result = Ok(())
128162024-12-06T20:57:59.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128172024-12-06T20:57:59.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128182024-12-06T20:57:59.047ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 196.228289ms iteration = 28 status = 0
128192024-12-06T20:57:59.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128202024-12-06T20:57:59.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128212024-12-06T20:57:59.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128222024-12-06T20:57:59.056ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 204.839301ms iteration = 28 status = {}
128232024-12-06T20:57:59.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128242024-12-06T20:57:59.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128252024-12-06T20:57:59.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128262024-12-06T20:57:59.061ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
128272024-12-06T20:57:59.061ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
128282024-12-06T20:57:59.061ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "783aab3f-66da-4708-916c-54aa43aaceed", "date": "Fri, 06 Dec 2024 20:57:59 GMT"} })
128292024-12-06T20:57:59.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128302024-12-06T20:57:59.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128312024-12-06T20:57:59.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128322024-12-06T20:57:59.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128332024-12-06T20:57:59.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128342024-12-06T20:57:59.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128352024-12-06T20:57:59.075ZINFOnexus (BackgroundTasks): VPC route manager sled 0a667526-2006-419e-9b68-c251fd138c06 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
128362024-12-06T20:57:59.075ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128372024-12-06T20:57:59.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8344ce34-dbc7-447f-a5a8-80efa64f73fb", "date": "Fri, 06 Dec 2024 20:57:59 GMT"} })
128382024-12-06T20:57:59.077ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 225.824612ms iteration = 29 status = {}
128392024-12-06T20:57:59.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128402024-12-06T20:57:59.095ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128412024-12-06T20:57:59.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128422024-12-06T20:57:59.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128432024-12-06T20:57:59.128ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128442024-12-06T20:57:59.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128452024-12-06T20:57:59.130ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 3f4dfeaa-9f15-4056-949e-00e297bf26f0, rack_id: 06ed6b43-f7cd-4ed6-8c86-7494248aa355, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(3bc82521-db3e-4386-a88c-9f40234bd295) } rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
128462024-12-06T20:57:59.130ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128472024-12-06T20:57:59.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128482024-12-06T20:57:59.138ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
128492024-12-06T20:57:59.139ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "893bcf12-1a04-4608-85ab-bef0c9e382f1", "content-length": "134", "date": "Fri, 06 Dec 2024 20:57:58 GMT"} })
128502024-12-06T20:57:59.139ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
128512024-12-06T20:57:59.139ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 3bc82521-db3e-4386-a88c-9f40234bd295
128522024-12-06T20:57:59.139ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
128532024-12-06T20:57:59.139ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
128542024-12-06T20:57:59.139ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128552024-12-06T20:57:59.139ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128562024-12-06T20:57:59.139ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128572024-12-06T20:57:59.139ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
128582024-12-06T20:57:59.139ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
128592024-12-06T20:57:59.139ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
128602024-12-06T20:57:59.139ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355
128612024-12-06T20:57:59.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128622024-12-06T20:57:59.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128632024-12-06T20:57:59.145ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
128642024-12-06T20:57:59.145ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e07eeaaf-9c45-4708-9c2c-5b4ab7b68d67", "content-length": "2", "date": "Fri, 06 Dec 2024 20:57:58 GMT"} })
128652024-12-06T20:57:59.145ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
128662024-12-06T20:57:59.146ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa381468-7694-4067-ad45-b055ba6c086f", "content-length": "52", "date": "Fri, 06 Dec 2024 20:57:58 GMT"} })
128672024-12-06T20:57:59.146ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch_location = Switch0
128682024-12-06T20:57:59.146ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
128692024-12-06T20:57:59.189ZDEBGnexus (BackgroundTasks): client request SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
128702024-12-06T20:57:59.245ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5cc4dce8-d5d4-41c7-93ac-1730ae66b863", "date": "Fri, 06 Dec 2024 20:57:59 GMT"} })
128712024-12-06T20:57:59.245ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 switch = Switch0
128722024-12-06T20:57:59.245ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
128732024-12-06T20:57:59.245ZDEBGnexus (BackgroundTasks): client response SledAgent = 0a667526-2006-419e-9b68-c251fd138c06 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d7b527f-c674-4c02-acb2-3f194bd34439", "content-length": "691", "date": "Fri, 06 Dec 2024 20:57:59 GMT"} })
128742024-12-06T20:57:59.245ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
128752024-12-06T20:57:59.245ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
128762024-12-06T20:57:59.245ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
128772024-12-06T20:57:59.245ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 06ed6b43-f7cd-4ed6-8c86-7494248aa355 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d95b88d0-0939-4188-8ae2-17ad0d49a55d", "content-length": "682", "date": "Fri, 06 Dec 2024 20:57:59 GMT"} })
128782024-12-06T20:57:59.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128792024-12-06T20:57:59.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128802024-12-06T20:57:59.246ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 395.122526ms iteration = 29 status = {}
128812024-12-06T20:57:59.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128822024-12-06T20:57:59.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128832024-12-06T20:57:59.253ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128842024-12-06T20:57:59.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128852024-12-06T20:57:59.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128862024-12-06T20:57:59.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128872024-12-06T20:57:59.263ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 412.301269ms iteration = 28 status = {}
128882024-12-06T20:57:59.647ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
128892024-12-06T20:57:59.647ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
128902024-12-06T20:57:59.677ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
128912024-12-06T20:57:59.677ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:40441
128922024-12-06T20:57:59.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40441 req_id = 87316def-1269-496b-907f-a30f00d3f662 roles = RoleSet { roles: {} } uri = /metrics/producers
128932024-12-06T20:57:59.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40441 req_id = 87316def-1269-496b-907f-a30f00d3f662 resource = Database result = Ok(()) uri = /metrics/producers
128942024-12-06T20:57:59.711ZINFOnexus: assigned collector to new producer collector_id = bef145b4-2934-45c3-870a-63d45572bde4 file = nexus/src/app/oximeter.rs:76 producer_id = e9fe68b0-d53c-4161-a621-681677d5b0d6
128952024-12-06T20:57:59.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34253 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40441 req_id = 87316def-1269-496b-907f-a30f00d3f662 response_code = 201 uri = /metrics/producers
128962024-12-06T20:57:59.711ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "87316def-1269-496b-907f-a30f00d3f662", "content-length": "41", "date": "Fri, 06 Dec 2024 20:57:59 GMT"} })
128972024-12-06T20:57:59.714ZDEBGnexus (producer-registration-task): registered with nexus successfully
128982024-12-06T20:57:59.714ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
128992024-12-06T20:58:00.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4b50ebac-a1c9-407d-bf9b-c2e80add7373 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129002024-12-06T20:58:00.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4b50ebac-a1c9-407d-bf9b-c2e80add7373 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129012024-12-06T20:58:00.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 4b50ebac-a1c9-407d-bf9b-c2e80add7373 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129022024-12-06T20:58:01.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b802a99-5511-405b-b71e-360499e0050b roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129032024-12-06T20:58:01.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b802a99-5511-405b-b71e-360499e0050b resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129042024-12-06T20:58:01.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b802a99-5511-405b-b71e-360499e0050b response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129052024-12-06T20:58:02.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b3f2f7f-4248-4b00-a854-26d621da90cf roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129062024-12-06T20:58:02.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b3f2f7f-4248-4b00-a854-26d621da90cf resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129072024-12-06T20:58:02.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5b3f2f7f-4248-4b00-a854-26d621da90cf response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129082024-12-06T20:58:02.412ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 477 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 8fbc7ef5-abb1-486e-80b6-83dd6d85bda5 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
129092024-12-06T20:58:03.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 178fa35c-0757-44fd-81c4-4d90fec7dd1a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129102024-12-06T20:58:03.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 178fa35c-0757-44fd-81c4-4d90fec7dd1a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129112024-12-06T20:58:03.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 178fa35c-0757-44fd-81c4-4d90fec7dd1a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129122024-12-06T20:58:04.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 478afbb9-7e02-460e-9364-662f10d7ca30 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129132024-12-06T20:58:04.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 478afbb9-7e02-460e-9364-662f10d7ca30 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129142024-12-06T20:58:04.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 478afbb9-7e02-460e-9364-662f10d7ca30 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129152024-12-06T20:58:05.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 37433a33-c346-47ba-af41-b1b45ef3a787 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129162024-12-06T20:58:05.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 37433a33-c346-47ba-af41-b1b45ef3a787 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129172024-12-06T20:58:05.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 37433a33-c346-47ba-af41-b1b45ef3a787 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129182024-12-06T20:58:06.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a8da08e7-7e4a-4805-bc62-e7b6e0565af7 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129192024-12-06T20:58:06.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a8da08e7-7e4a-4805-bc62-e7b6e0565af7 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129202024-12-06T20:58:06.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = a8da08e7-7e4a-4805-bc62-e7b6e0565af7 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129212024-12-06T20:58:07.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1e0df44a-35a6-4db9-a019-710fd30e5524 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129222024-12-06T20:58:07.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1e0df44a-35a6-4db9-a019-710fd30e5524 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129232024-12-06T20:58:07.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 1e0df44a-35a6-4db9-a019-710fd30e5524 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129242024-12-06T20:58:08.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bb0d0e7e-1d5e-4c6f-8ec5-3d54ae5478e9 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129252024-12-06T20:58:08.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bb0d0e7e-1d5e-4c6f-8ec5-3d54ae5478e9 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129262024-12-06T20:58:08.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = bb0d0e7e-1d5e-4c6f-8ec5-3d54ae5478e9 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129272024-12-06T20:58:08.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
129282024-12-06T20:58:08.851ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
129292024-12-06T20:58:08.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129302024-12-06T20:58:08.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129312024-12-06T20:58:08.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129322024-12-06T20:58:08.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129332024-12-06T20:58:08.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129342024-12-06T20:58:08.853ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129352024-12-06T20:58:08.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129362024-12-06T20:58:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
129372024-12-06T20:58:08.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129382024-12-06T20:58:08.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129392024-12-06T20:58:08.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129402024-12-06T20:58:08.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129412024-12-06T20:58:08.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.050019ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
129422024-12-06T20:58:08.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129432024-12-06T20:58:08.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
129442024-12-06T20:58:08.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129452024-12-06T20:58:08.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129462024-12-06T20:58:08.910ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
129472024-12-06T20:58:08.910ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.796472ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
129482024-12-06T20:58:09.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d1efb06-ff3a-437f-b9a7-bc056d644af1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129492024-12-06T20:58:09.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d1efb06-ff3a-437f-b9a7-bc056d644af1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129502024-12-06T20:58:09.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 8d1efb06-ff3a-437f-b9a7-bc056d644af1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129512024-12-06T20:58:10.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5da936dc-2b54-4b69-af54-6cfd246031a1 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129522024-12-06T20:58:10.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5da936dc-2b54-4b69-af54-6cfd246031a1 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129532024-12-06T20:58:10.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 5da936dc-2b54-4b69-af54-6cfd246031a1 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129542024-12-06T20:58:11.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 026d9d62-bc7e-41a6-919d-cee1fcec73f2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129552024-12-06T20:58:11.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 026d9d62-bc7e-41a6-919d-cee1fcec73f2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129562024-12-06T20:58:11.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 026d9d62-bc7e-41a6-919d-cee1fcec73f2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129572024-12-06T20:58:12.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f5641f99-1aa9-4351-b3b7-79d972feccc2 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129582024-12-06T20:58:12.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f5641f99-1aa9-4351-b3b7-79d972feccc2 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129592024-12-06T20:58:12.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f5641f99-1aa9-4351-b3b7-79d972feccc2 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129602024-12-06T20:58:12.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = b34aa211-de44-449e-968d-e46212ada2a1 roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
129612024-12-06T20:58:12.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = b34aa211-de44-449e-968d-e46212ada2a1 resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
129622024-12-06T20:58:12.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = b34aa211-de44-449e-968d-e46212ada2a1 response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?sort_by=id_ascending
129632024-12-06T20:58:12.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 8222ef69-4f1e-41b5-820a-e4e8e06f809a roles = RoleSet { roles: {} } uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
129642024-12-06T20:58:12.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 8222ef69-4f1e-41b5-820a-e4e8e06f809a resource = Database result = Ok(()) uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
129652024-12-06T20:58:12.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64821 req_id = 8222ef69-4f1e-41b5-820a-e4e8e06f809a response_code = 200 uri = /metrics/collectors/bef145b4-2934-45c3-870a-63d45572bde4/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZDEyZmI0Zi1lNjJkLTRjYWItYTRiZC0yMDI0ZjI1NDZkM2IifX0%3D
129662024-12-06T20:58:12.411ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 564 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = f4853e1e-e64a-4b6d-bc15-e5be536bea77 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
129672024-12-06T20:58:13.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = caa7d95e-4945-40ce-be13-4724a2089ca4 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129682024-12-06T20:58:13.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = caa7d95e-4945-40ce-be13-4724a2089ca4 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129692024-12-06T20:58:13.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = caa7d95e-4945-40ce-be13-4724a2089ca4 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129702024-12-06T20:58:14.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7ac52c47-e23e-44ec-9b9f-a7a011e36b75 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129712024-12-06T20:58:14.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7ac52c47-e23e-44ec-9b9f-a7a011e36b75 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129722024-12-06T20:58:14.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 7ac52c47-e23e-44ec-9b9f-a7a011e36b75 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129732024-12-06T20:58:15.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9a3b5145-105f-4b7b-8195-f9169e087472 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129742024-12-06T20:58:15.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9a3b5145-105f-4b7b-8195-f9169e087472 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129752024-12-06T20:58:15.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 9a3b5145-105f-4b7b-8195-f9169e087472 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129762024-12-06T20:58:16.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b95a60d4-2808-4a33-9bda-8fedbb0c3626 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129772024-12-06T20:58:16.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b95a60d4-2808-4a33-9bda-8fedbb0c3626 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129782024-12-06T20:58:16.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = b95a60d4-2808-4a33-9bda-8fedbb0c3626 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129792024-12-06T20:58:17.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f662c013-df16-4bd5-80d4-b5d652e3b1f0 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129802024-12-06T20:58:17.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f662c013-df16-4bd5-80d4-b5d652e3b1f0 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129812024-12-06T20:58:17.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = f662c013-df16-4bd5-80d4-b5d652e3b1f0 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129822024-12-06T20:58:18.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 971b0fca-8996-4144-9b98-ce94ac5af191 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129832024-12-06T20:58:18.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 971b0fca-8996-4144-9b98-ce94ac5af191 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129842024-12-06T20:58:18.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 971b0fca-8996-4144-9b98-ce94ac5af191 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
129852024-12-06T20:58:18.851ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
129862024-12-06T20:58:18.852ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
129872024-12-06T20:58:18.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129882024-12-06T20:58:18.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129892024-12-06T20:58:18.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129902024-12-06T20:58:18.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129912024-12-06T20:58:18.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129922024-12-06T20:58:18.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
129932024-12-06T20:58:18.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129942024-12-06T20:58:18.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129952024-12-06T20:58:18.858ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129962024-12-06T20:58:18.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129972024-12-06T20:58:18.859ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129982024-12-06T20:58:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 4488c621-7722-4fff-aaa7-5047bdc4fd48, lookup_type: ById(4488c621-7722-4fff-aaa7-5047bdc4fd48) } result = Ok(())
129992024-12-06T20:58:18.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130002024-12-06T20:58:18.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130012024-12-06T20:58:18.874ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 original_time_created = 2024-12-06 20:44:20.315112 UTC target_id = 4488c621-7722-4fff-aaa7-5047bdc4fd48 time_created = 2024-12-06 20:44:20.315112 UTC
130022024-12-06T20:58:18.874ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.376957ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"4488c621-7722-4fff-aaa7-5047bdc4fd48","time_created":"2024-12-06T20:44:20.315112Z"}
130032024-12-06T20:58:18.881ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130042024-12-06T20:58:18.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130052024-12-06T20:58:18.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.42003ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130062024-12-06T20:58:19.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 49502c78-1397-4d8b-a2b8-9b036a891246 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130072024-12-06T20:58:19.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 49502c78-1397-4d8b-a2b8-9b036a891246 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130082024-12-06T20:58:19.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 49502c78-1397-4d8b-a2b8-9b036a891246 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130092024-12-06T20:58:20.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 515e4fe5-1e9b-480a-a729-d9cf3ff17202 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130102024-12-06T20:58:20.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 515e4fe5-1e9b-480a-a729-d9cf3ff17202 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130112024-12-06T20:58:20.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 515e4fe5-1e9b-480a-a729-d9cf3ff17202 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130122024-12-06T20:58:21.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c9afa614-395f-47a6-91f9-eef1356afc73 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130132024-12-06T20:58:21.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c9afa614-395f-47a6-91f9-eef1356afc73 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130142024-12-06T20:58:21.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = c9afa614-395f-47a6-91f9-eef1356afc73 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130152024-12-06T20:58:22.411ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 560 local_addr = [fd00:1122:3344:101::c]:51868 method = GET remote_addr = [fd00:1122:3344:101::d]:47103 req_id = 8db82b47-f911-496e-9015-9dd2b44fef75 response_code = 200 uri = /e9fe68b0-d53c-4161-a621-681677d5b0d6
130162024-12-06T20:58:22.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 041cad0f-3bc9-49be-91b6-bebd1d6cee8a roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130172024-12-06T20:58:22.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 041cad0f-3bc9-49be-91b6-bebd1d6cee8a resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130182024-12-06T20:58:22.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 041cad0f-3bc9-49be-91b6-bebd1d6cee8a response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130192024-12-06T20:58:23.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 88f8a618-3f38-44a1-b352-227229491675 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130202024-12-06T20:58:23.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 88f8a618-3f38-44a1-b352-227229491675 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130212024-12-06T20:58:23.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 88f8a618-3f38-44a1-b352-227229491675 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130222024-12-06T20:58:24.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2f208ae1-634b-4b15-a063-02b932055587 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130232024-12-06T20:58:24.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2f208ae1-634b-4b15-a063-02b932055587 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130242024-12-06T20:58:24.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 2f208ae1-634b-4b15-a063-02b932055587 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130252024-12-06T20:58:25.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3b2880f3-0a5d-4f6a-a7e1-b2794bf572a3 roles = RoleSet { roles: {} } uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130262024-12-06T20:58:25.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3b2880f3-0a5d-4f6a-a7e1-b2794bf572a3 resource = Database result = Ok(()) uri = /probes/0a667526-2006-419e-9b68-c251fd138c06
130272024-12-06T20:58:25.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43252 req_id = 3b2880f3-0a5d-4f6a-a7e1-b2794bf572a3 response_code = 200 uri = /probes/0a667526-2006-419e-9b68-c251fd138c06